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Abstract 


For real parameter single objective optimization, Differential Evolution (DE) and Covariance Matrix 
Adaptation Evolution Strategy (CMA-ES) both perform powerfully. Nevertheless, in the field of 
real parameter single objective optimization, it is impossible for a given algorithm to perform well 
in all fitness landscapes. Practice has proved that ensemble of different algorithms may lead to 
improvement in solution. In this paper, based on two famous population-based metaheuristics - L- 
SHADE-EpSin and HS-ES, we propose ensemble with successively executed constituent algorithms 
- HS-ES-DE. In our algorithm, HS-ES is replaced by L-SHADE-EpSin after stagnation is detected. 
Beside our HS-ES-DE, 12 population-based metaheuristics are involved in our experiments in which 
three benchmark test suites are employed. Experimental results show that our algorithm is very 
competitive. 

Keywords: Real parameter single objective optimization, population-based mataheuristic, 


ensemble, stagnation 


1. Introduction 


Real parameter single objective optimization aims to find the best decision vector in solution 
space to minimize (or maximize) an objective function which is a research focus in artificial intel- 
ligence. So far, a variety of population-based metaheuristics have been proposed in this field. Top 


evolutionary computation venue, Congress of Evolutionary Computation (CEC), held at least six 
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competitions on real parameter single objective optimization among population-based metaheuris- 
tics annually. 

The CEC competitions are famous in the research of real parameter single objective optimization 
and have a great impact on the future research directions in this field. We briefly introduce the 


winners of each of the competitions as follows. 


e NBIPOP-aCMA-ES [10], the winner in 2013, is a variant of Covariance Matrix Adaptation 
Evolution Strategy (CMA-ES) [6] with a restart scheme including two regimes; 


L-SHADE [I7], the winner in 2014, a variant of Differential Evolution (DE) [15], is extended 
from SHADE with the Linear Population Size Reduction (LPSR). 


e UMOEAs-II [5], a joint winner in 2016, is ensemble of DE and CMA-ES. 


L-SHADE-EpSin [2], the other joint winner in 2016, is a variant of L-SHADE with adaptive 


parameter settings and the local search based on Gaussian walks. 


EBOwithCMAR [8], the winner in 2017, is a self-adaptive butterfly optimizer with the success 


history based adaption, the LPSR, and the covariance matrix adapted retreat phase; 


e HS-ES [22], the winner in 2018, is controlled by CMA-ES with a restart scheme and an 


improved version of the univariate sampling. 


e IMODE [I], the winner in 2020, is a DE algorithm with three DE mutation strategies and 


the sequential quadratic programming. 


Among these seven winners, NBIPOP-aCMA-ES and HS-ES are based on CMA-ES, while L- 
SHADE, L-SHADE-EpSin, and IMODE are based on DE. Moreover, UMOEAs-II is based on both 
CMA-ES and DE. In [14], further comparison shows that UMOEA-I, L-SHADE-EpSin, and HS-ES 
are top performers among the six winners in the previous five competitions. This means that the 
top three performers in the previous five competitions are based on DE and/or CMA-ES. Thus, 
it can be seen according to the CEC competitions that both CMA-ES and DE perform better in 
real parameter single objective optimization than other approaches. DE and CMA-ES were initially 
proposed in [I5] and [7] respectively. In the population of DE, operators such as mutation, crossover 
and selection, are exerted on individuals, i.e., target vectors. In the evolutionary framework of DE, 


trail vectors for next generation are produced via mutation firstly and then crossover which are 
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specified as trail vector generation strategies. In the stage of selection, a target vector or its 
trial vector is chosen based on fitness comparison to be a target vector of the next generation. 
In population of CMA-ES, individual center is the key to generate next generation. Specifically, 
individual center is initialized by the part of individuals with better fitness than the others. Then, 
new individuals are generated by sampling from a Gaussian distribution based on the individual 
center. After that, individual center of the next generation is decided. The motivation of this paper 
is given below. It has be proven that CMA-ES is easy to fall into stagnation, the state means 
existing difference among individuals not enough to support valid search any more. Therefore, in 
both NBIPOP-aCMA-ES and HS-ES, restart is employed to enhance CMA-ES. Furthermore, in 
HS-ES, the improved version of univariate sampling is called after the step of CMA-ES for further 
enhancement. In fact, compared with restart and the univariate sampling, it may be more useful 
that another powerful population-based metaheuristic takes over search after stagnation of CMA- 
ES. Based on the idea, we can obtain ensemble with successively executed constituent algorithms. 

In this paper, we propose HS-ES-DE, an ensemble of HE-ES and L-SHADE-EpSin. Both of 
the constituent algorithms are winners in the CEC competitions. Our proposed algorithm starts 
with HS-ES where a scheme is applied to detect stagnation. In detail, stagnation is confirmed 
provided that improving ratio of the average fitness from the previous generation to the current one 
is lower than a threshold for a given number of contiguous generations. After stagnation detected, 
HS-ES hand over the evolutionary procedure to L'SHADE-EpSin. For taking over, population size 
and population diversity are both adjusted by our scheme. The initial value of population size of 
L-SHADE-EpSin - NP_DE ax - is calculated based on the rest number of function evaluations 
before taking over. Then, in the last generation for the step of CMA-ES, NP_DE ax individuals 
are produced. After that, mutation and crossover in the original version of DE [I5] is executed 
for a number of generations. In the generations, offspring produced by the trial vector generation 
strategy are all directly selected without considering fitness to improving diversity. 

We evaluate our proposed algorithm on the benchmark test suites of CEC 2014, 2017, and 2020 
for real parameter single objective optimization. In the first experiment based on the CEC 2014 
benchmark test suite, we compare our HS-ES-DE with L-SHADE-Epsin, HS-ES, and other seven 
population-based metaheuristics when dimensionality are set 30, 50, and 100, respectively. In the 
second experiment based on the CEC 2017 benchmark test suite, we compare HS-ES-DE with 


the same algorithms when dimensionality are set 30. In the third experiment based on the CEC 
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2020 benchmark test suite, we compare our algorithm with the top three algorithms in the 2020 
competitions when dimensionality are set 20. The experimental results show that our algorithm 
outperforms other population-based metaheuristics for real parameter single objective optimization. 

The rest of this paper is organized as follows. We firstly reviewed related work in Section II. 
Section II explains the details of our proposed algorithm. Experimental results are demonstrated 


and discussed in Section IV with a conclusion in Section V. 


2. Related Work 


In this section, we reviewed recent research on population-based metaheuristics for real pa- 
rameter single objective optimization in an ensemble way covering ensembled DE algorithms and 
ensembled population-based metaheuristics. 

Wu [20] proposed MPEDE which simultaneously consists of three mutation strategies. There 
are three equal-sized smaller indicator subpopulations and one much larger reward subpopulation in 
population of MPEDE. Each constituent mutation strategy controls one indicator subpopulation. 
The current best performing mutation strategy is determined according to the ratio between fitness 
improvement and consumed function evaluations every a certain number of generations. Then the 
reward subpopulation is allocated to the determined best performing mutation strategy dynamically. 
Mostafa et al. [I] presented sTDE-dR whose population is clustered in multiple tribes and utilizes an 
ensemble of different mutation and crossover strategies. Both the life cycle and participation ratio 
for the next generation are determined by a success-based scheme. In each tribe, scaling factor and 
crossover rate are controlled by a different adaptive scheme. The mean success of each tribe is used 
to calculate the participation ratio for the next generation. Population size is dynamically reduced 
during execution. Sallam et al. proposed a DE algorithm considering both fitness landscapes 
and performance history of the operators to dynamically selecting the most suitable operator. Cui 
et al. [3] presented AMECoDEs which employs two elites-guided trial vector generation strategies 
for each individual to generate two candidate solutions accordingly. In fact, only the better one 
can participate in selection. Wu et al. proposed EDEV which consists of three highly popular 
and efficient DE variants - JADE [23], CoDE [19], and EPSDE. Similar with MPEDE, there are 
three indicator subpopulations and a reward subpopulation in population. Also, the competition 
mechanism for the four subpopulations are similar with that in MPEDE. Zhang et al. suggested 


MLCC framework which implements a parallel structure with the entire population simultaneously 
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monitored by multiple DE algorithms assigned to different layers. An individual can store, utilize 
and update its evolution information in different layers. MLCC-SI is regarded as the representative 
of MLCC-based DE algorithms. 

Elsayed et al. proposed UMOEAs-II which employ a DE algorithm with multiple combina- 
tions of operators and CMA-ES. Each of the two constituent algorithms controls a subpopulation. 
The two subpopulation shares information at intervals. Liu et al. [9] presented CETMS based 
on tissue membrane systems and CMA-ES. In the framework of the tissue-like membrane system, 
network structure consists of several of cells. Each cell has its own multisets of objects. CMA-ES 
is employed as the reaction rules to evolve objects in different cells. Mohamed et al. suggested 
L-SHADE-SPACMA in which individuals are controlled by either L-SHADE-SPA or a modified 


version of CMA-ES. Better performer can control more individuals. 


3. Methodology 


In this section, we present the details of HS-ES and L-SHADE-EpSin firstly. Then, based on 
our analysis on the two algorithms, we introduce our algorithm - HS-ES-DE. The pseudo-code of 


all the three algorithms is given here. 


3.1. The involved two population-based metaheuristic 
3.1.1. HS-ES 

The pseudo-code of HS-ES is in Algorithm In essence, HS-ES is ensemble of the improved 
version of the univariate sampling [22] and CMA-ES [6]. Here, the two constituent algorithms are 
not further explained. Details of them can be found in [22] and [6]. 


8.1.2. L-SHADE-EpSin 

The pseudo-code of L-SHADE-EpSin is given in Algorithm [2] followed by the equations required 
further explanation. Nevertheless, mutation, crossover, and selection, which are all inherited from 
JADE [23], are not detailedly explained here. 

In the first stage of LSSHADE-EpSin, the non-adaptive sinusoidal decreasing adjustment for 
each target vector in the gth generation is 


1 Gmax = 
Fig = 5: (snr: freg gta): S 41), (1) 
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Algorithm 1 The pseudo-code of HS-ES 


Input: NP,, population size in the first step based on the univariate sampling; NP2, population size of CMA-ES 


(variable); NP3, population size of the final step based on the univariate sampling; G, the maximum number 


of generations for the first step of the univariate sampling; T, the maximum times of CMA-ES execution; Thr, 


threshold; MaxF ES, the maximum number of fitness evaluations 


Parameter: t, g, Si, So, FES 


T: 
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15: 
16: 
17: 
18: 
19: 
20: 
21: 
22: 
23: 


g=0, FES =0 


: Initialize 


: while g < G do 


Implement the improved version of the univariate sampling on a randomly selected dimension 
g=g+1 
end while 


FES = FES +G. NP, 


: Sı < the best solution 


: while t < T do 


Regard Sı as the beginning of CMA-ES 
repeat 
Implement CMA-ES for a generation 
FES = FES + NP 
until the difference between the current best solution and the best solution in the previous generation is less 
than Thr 
end while 
S2 + the best solution in the step of CMA-ES 
while FES < MaxFES do 
Detect which dimension of S2 needed be fixed 
Fix the detected dimension with the univariate sampling 
FES = FES + N P 
S2 < the best solution 
end while 


Report S2 


Algorithm 2 The pseudo-code of L-SHADE-EpSin 


Input: NPmazx, the maximum value of population size; NPmin, the minimum value of population size; MaxrF ES, 


the maximum number of fitness evaluations 


Parameter: Sfreq, Sr, SCR, HF, Cr, and, Freq, FES 


1: pF = 0.5, Cr = 0.5, Freq = 0.5, FES = 0, g = 1, and NP = N Pmax 
2: while FES <= MaxFES do 
3 if FES <= 0.5 - MarFES then 
4 for i = 1 to NP do 
5: Generate a random number c = rand(0, 1) 
6 if c < 0.5 then 
7 Generate Fi g using the non-adaptive decreasing adjustment shown in Equation [1] 
8 else 
9 Generate F; g using the adaptive increasing adjustment shown in Equation [2] 
10: end if 
11: Generate Cr;,g based on Equation [5] 
12: end for 
13: else 
14: Sr, SCR =Q 
15: for i = 1 to NP do 
16: Generate a random index r; = rand(1, H) 
IT: Generate Fi g and Cri, g based on Equations [4] and f] respectively 
18: end for 
19: end if 
20: for i = 1 to NP do 
21: Generate p; = rand(0,1)- N, where N = 0.1 - NP 
x 22: Mutation based on DE/current-to-pbest/1 with the optional external archive 
23: Binomial crossover 
24: Selection 
d 25: Store successful freqi,g, Fi,g, and Cri, g in Spreq, Sp, and Scr, respectively 
26: end for 


27: Compute ufreqr;,g+1, HFri,g+1, and uCrr;,g+1 based on Equations [6] [7] and [8] respectively 
28: Call the LPSR according to Equation [12] 
29: if NP < 20 for the first time then 


30: Call the local search based on Gaussian Walks based on Equation [13] 
31: end if 
32: g=g+1 


33: end while 
34: Report solution 
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where 7 is from 1 to NP, g is the current generation number, freq represents the frequency of sinu- 
soidal function, and Gmaz is the maximum generation, which is computed based on the maximum 
number of function evaluations MaxF'ES and the settings of the LPSR. Meanwhile, the adaptive 


sinusoidal increasing adjustment for each target vector in the gth generation is 
1 : g 
Fg =x" sin (27 - freq; g: 9) =— +1 3 (2) 
2 i Guar 
where freq; , is computed based on Equation [3] 
freqi g = randc (ufreq,.,,0.1) (3) 


In Equation ufreq,, is chosen randomly from the external memory Mfyeq which stores the 


successful mean frequencies in history. In the second stage, 
F; g = randc(pF,,,0.1) , (4) 


where pF, is chosen randomly from the external memory Mp which stores the successful mean of 


F in history. During the whole course, 
Cri g = randn(pCr,,,0.1), (5) 


where pCr,, is chosen randomly from the external memory Mc, which stores the successful mean 


of Cr in history. For update, 


LfTegr,.g+1 = Meany (Sfreq) 5 (6) 
LF, .g+1 = Means (Sr), (7) 
HCR, 941 = meany (Scr). (8) 


Here, meanz(Sfreq), Mean (Sr), and mean, (Scr) are all computed based on the following equa- 


tions, 
[S| 2 
means (5) = Zit i, (9) 
din Wi Si 
Afi 
es! iA 
Afi = |F (uig) — f (£ig)l: (11) 
For the LPSR, 
NP = Round{ NFimin—Ni'maz | png 4 NP ] (12) 
al MaxFES ees 
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For the Gaussian Walks, ten randomly selected target vectors are reinitialized. After that, in the 


following Gis generations, 
Ym = Gaussian( Hp, 7) + (€ Zmbest — Ê Lm); (13) 


where m € [1,10] e and ê are two uniform random numbers in the range [0,1], and Zmbese is the 
best individual among the reinitialized ten ones. Here, 


_ |log(G) 
~| G 


(or 


. (Zm Embest) (14) 


8.2. Our algorithm 


The first step of HS-ES for the univariate sampling can be regarded as a initialization method 
better than randomization. In the second step, CMA-ES may run more than one time. However, 
the termination of each CMA-ES execution may be long before stagnation, because the criterion for 
termination - no progress on best solution in just one generation - cannot reflect stagnation in most 
occasions. That is, in HS-ES, CMA-ES is employed even repeatedly to just obtain approximate 
solution. After that, the univariate sampling is expected for further progressing based on the 
foundation made by CMA-ES. 

We believe that the first step for initialization is reasonable. Nevertheless, it may be a better 
choice that CMA-ES is executed until stagnation occurs. After all, CMA-ES is powerful. To make 
use of the remaining fitness evaluations after stagnation, another population-based metaheuristic 
may take over population. Here, we choice L-SHADE-EpSin. Reasons are given below. Firstly, 
L-SHADE-EpSin can keep search ability longer than many other population-based metaheuristics. 
The fact can be reflected in our following experiments. In addition, as a DE algorithm with the 
LPSR, L-SHADE-EpSin cost much less fitness evaluations in generations of the later stage than in 
those of the earlier stage. 

Considering these issues, we propose HS-ES-DE shown in Algorithm] Improving rate of average 
fitness JR in Step 12 is calculated as 
If po f d 

fy 


where To denotes the average fitness in the previous generation and f, denotes the average fitness 


IR= ; (15) 


in the current generation. It can be seen from Step 12 that we use a very strict criterion to detect 


stagnation. 
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Algorithm 3 The pseudo-code of HS-ES-DE 


Input: NP,, population size in the first step based on univariate sampling; NP2, population size of CMA-ES 


(variable); NP_DE, population size of LLSHADE-EpSin (variable); G, Maximum generations for the first step of 


univariate sampling; Thr, threshold; Geni, number of generations for detecting improving rate of average fitness; 


Genz, number of generations for executing the original version of DE mutation and crossover; MaxFES, the 


maximum number of fitness evaluations 


Parameter: g, S1, FES 


T: 


=. e n 
a E 


13: 


14: 
15: 
16: 
LT: 
18: 
19: 
20: 
21: 
22: 
23: 


g=0, FES=0 


: Initialize 


: while g < G do 


Implement the improved version of univariate sampling on randomly selected dimension 
g=g+1 
end while 


FES = FES +G. NP, 


: Regard S1, the best solution, as the beginning of the step of CMA-ES 


: repeat 


Implement CMA-ES for a generation 
FES = FES + NP} 


: until improving rate of average fitness, which is shown in Equation [15] has been lower than Thr in contiguous 


Gen, generations 
Execute CMA-ES one more generation without fitness evaluation to obtain NP_DEjn;4 counted based on Equa- 
tion 
g=0 
while g < Gen2 do 
Execute the original version of DE mutation and crossover 
Directly select offspring without fitness evaluation 
end while 
while FES < MaxFES do 
Execute L-SHADE-EpSin 
FES = FES + N Ps 
end while 


Report solution 
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To produce the right number of individuals for L-SHADE-EpSin, CMA-ES is executed without 
fitness evaluation in one more generation after stagnation is confirmed. Then, individuals are 
diversified based on DE with directly selecting offspring. Similarly, fitness evaluation is not required 


here. In short, our processing scheme on population for taking over requires no fitness evaluation. 


4. Experiments 


In our experiments, we compare our HS-ES-DE with 12 population-based metaheuristics based 
on the CEC 2014, 2017, and 2020 benchmark test suites. In the three suites, functions can be 


divided into four types as shown in Table In our comparison based on the CEC 2014 and 


Table 1: Classification of the functions in the CEC 2014 and CEC 2017 benchmark test suites 


Function 
Type 
2014 2017 2020 
Unimodal F1-F3 F1-F3 Fl 
Simple multimodal F4-F16 F4-F10 F2-F4 
Hybrid F17-F22 F11-F20 F5-F7 
Composition F23-F30 F21-F30 F8-F10 


2017 suites, LLSHADE-EpSin, UMOEAs-II, MPEDE, ETIJADE [4], HS-ES, AMECoDEs, EDEV, 
MLCC-SI, and NDE are selected as peers. That is, the top three performers in the CEC 
competitions and some up-to-date algorithms are involved. It requires to be emphasized that the 
maximum number of fitness evaluations is significantly increased in the CEC 2020 competition on 
real parameter single objective optimization. The top three algorithms in the competition with the 
new rule are IMODE, AGSK, and j2020. In our comparison based on CEC the 2020 suite, peers 


are just the above three population-based metaheuristics. 


4.1. Experimental setting 


Settings of all the algorithms are shown in Table |2| where D denotes dimensionality. In fact, 
in our HS-ES-DE, just the listed parameters need be considered. The value of other parameters 


coming from HS-ES and L-SHADE-EpSin is still kept by us. 
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Table 2: Settings of the involved algorithms 


Algorithm Parameters 

L-SHADE-EpSin NPmex = D-18, NPmin = 4, |A| = 1.4 x NP, H = 5, freq = 0.5, and Gis = 250 

UMOEAs-II NPmax = D -18 + 4 + |log(D) - 3], NPmin = 8 + |log(D)-3] , probis = 0.1, and cfergs = D- 2000 

MPEDE NP = 250, \1 = à2 = AZ = 0.2, and ng = 20 

ETILJADE NP = 100, wr = 0.5, por = 0.5, c= 0.1, |A| = 100, and p = 0.05 

HS-ES NP, = 200, NP2 = 80+ |In(D) - 3], NP3 = 450 when D = 50, NP3 = 600 when D = 100, cc = 0.96, I = 20, 
NSteP! — 100, NSteP4 = 360 when D = 50, and N**¢?4 = 480 when D = 100 

AMECoDEs NP = 200, p = 0.1, c= 0.1, e = 0.001, and |A| = 200 

EDEV NP = 50, A\1 = à2 = A3 = 0.1, A1 = 0.7, and ng = 20 

MLCC-SI NP=D-5, N=0.05 

NDE NPmaz = 300, NPmin = 5, gm = 10, and c = 0.1 

IMODE NPmax = D? - 6, NPmin = 4, A = 2.6, H = D-20, and FESLs = MaaFES - 0.85 

AGSK NPmaz = D-20, NPmin = 12, p = 0.05, and c = 0.05 

j2020 bNP=D.-7,sNP=D, 7 =0.1, T2 = 0.1, ageLmt = Mart BS, eps = le — 16, myEqs = 25 

HS-ES-DE Gen; = 50, Geng = 4, Thr = 1E — 11, F = 0.2 (for mutation of the original version of DE), 


Cr = 0.5 (for crossover of the original version of DE) 


In our experiments based on CEC 2014 and 2017 suites, the maximal number of function eval- 


uations MaxF E'S is set D - 10000, i.e., 3.0E+05, 5.0E+05 and 1.0E+06 when D = 30, D = 50 


and D = 100, respectively, based on the rule of the previous CEC competitions. In our experiment 


based on CEC 2020 suites, Wax FES is set to 2.0E+05 and 1.0E+07, respectively, when D = 20. 


The former value is set based on the rule of the previous CEC competitions, while the latter value 


is set based on the rule of the CEC 2020 competition. For comparison, algorithm is always executed 


30 times in each case. 


4.2. Comparison based on the CEC 2014 suite 


In this experiment, our algorithm is compared with the nine population-based metaheursitics 


mentioned above based on the CEC 2014 suite. The experimental results for the functions with 30, 


50, and 100 in D are listed in Tables [3}5] respectively. 


12 


Table 3: Results of the ten algorithms for the CEC 2014 functions with 30 in dimensionality. ”+” or ”—” denotes that 


the current result is significantly better or statistical worse than the result of our algorithm in terms of Wilcoxon’s 


rank sum test at a 0.05 significance level, respectively. 


difference 


er 


Meanwhile, ”” represents that there is no significant 


Average (standard deviation) 


Funckiana L-SHADE-EpSin UMOBAs-II MPEDE ETI-JADE HS-ES AMECoDEs EDEV MLCC-SI NDE HS-ES-DE 
Fl 7.579E-15 1.960B-11 1.386B-04 5.819B+02 3.571E-10 1.137B-14 3.259E+03 2.982B+03 5.498E+02 3.174B-14 
(7.211B-15)+4 (3.251B-11)— (5.288B-04) = (1.075E+03) — (3.199B-10)— (5.782B-15)+ (9.097E+03) — (3.293E+403) — (1.314E+03)— (2.033E-14) 
F2 0.000E+00 1.137E-14 0.000E+00 0.000E+00 3.272E-10 1.895E-15 0.000E+00 0.000E+00 0.000E+00 0.000E+00 
(0.000E-+00)= (1.416B-14) — (0.000B+00) (0.000E+00) (6.497B-10) — (7.211B-15)= (0.000E+00) = (0.000E+00)% (0.000E+00) = (0.000E+00) 
F3 0.000E+00 7.579E-15 4.358E-14 4.351E-04 3.098E-10 7.579E-15 0.000E+00 0.000E+00 0.000E+00 0.000E+00 
(0.000E+00)~ (1.965E-14)— (2.445E-14)— (8.813E-04)— (4.597E-10)— (1.965E-14)— (0.000E+00) = (0.000E+00) = (0.000E+00) (0.000E+00) 
F4 2.653E-13 4.358E-14 2.201E-04 3.979E-14 3.049E-11 1.137B-14 6.863E-03 7.281E-07 7.738B-04 0.000E+00 
(1.004B-12)— (3.231B-14) — (1.099B-03) — (3.702B-14) — (4.406B-11)— (2.313B-14)— (2.553B-02)— (3.384B-06) — (1.532B-03) — (0.000E+00) 
F5 2.011E+01 2.000E+01 2.038E+01 2.001E+01 2.000E+01 2.000E+01 2.039E+01 2.021E+01 2.016E+01 2.000E+01 
(2.225B-02) — (7.123B-04)+ (4.902B-02) — (2.379B-02) — (5.649B-04) = (1.135B-03) — (5.110B-02) — (5.611B-02)— (8.502B-02) — (6.995B-04) 
F6 1.506E-05 2.288E-05 5.665E+00 5.446E-01 7.891E-01 5.432E-01 5.209B-01 1.097E+00 2.377E+00 8.279E-01 
(8.250B-05)+ (9.533B-05) = (4.667E+00) — (6.927B-01) = (1.226B+00) = (1.001E+00) = (1.159E+00)% (1.837E+00)% (2.285E+00)— (9.037E-01) 
F7 0.000E+00 3.790E-15 3.286E-04 2.465E-04 1.972E-11 0.000E+00 0.000E+00 7.579E-15 0.000E+00 0.000E+00 
(0.000E+00)= (2.076B-14) = (1.800B-03) = (1.350B-03) = (6.250B-11)— (0.000E+00) = (0.000E+00)% (2.884B-14)~ (0.000E+00) = (0.000E+00) 
F8 1.023E-13 9.095E-14 3.790E-15 0.000E+00 8.689E+00 0.000E+00 0.000E+00 1.895E-14 2.322E+00 3.283E+00 
= (3.469B-14)+ (4.625B-14)+ (2.076B-14)+ (0.000E+00)+ (2.625E+00) — (0.000E+00)+ (0.000E+00)+ (4.309B-14)+ (2.925E+00)+ (1.386E+00) 
=» 1.319E+01 7.628E-01 2.696E+01 2.111E+01 7.064E+00 4.088E+01 3.483E+01 2.176E+01 4.503E+01 6.803E+00 
(2.321E+00)— (8.540B-01)+ (7.257E+00) — (4.897E+00) — (2.618E+00) = (1.230E+01)— (5.457E+00)— (3.603E+00) — (2.150E+01) — (2.098E+00) 
10 2.082E-03 2.082E-03 3.083E+01 3.886E-02 4.174E+402 1.773E+00 2.144B+00 6.459E-01 4.374E+00 6.387E+01 
(6.353B-03)+ (8.381B-03)+ (1.176B+01)+ (2.366B-02)+ (2.330E+02) — (4.040B-01)+ (9.488E+00)+ (6.092B-01) (2.274B+401)+ (1.089B+02) 
CS: 1.171B+03 1.219B+03 3.040E+03 1.099B+03 6.849E+02 1.946B+03 2.509E+03 1.677E+03 2.101E+03 6.092E+02 
O (1.922E+02)— (2.345E+02)— (4.000E+02)— (3.750E+02)— (3.326E+02)% (4.963E+02)— (6.788E+02) — (3.400E+02)— (5.590E+02) — (2.572E+02) 
CS" 1.639B-01 9.378E-02 5.227E-01 8.331E-02 1.693B-02 4.196E-02 5.534B-01 2.554E-01 1.553E-01 1.692E-02 
A (1.771E-02)— (5.496B-02) — (9.219B-02) — (2.843B-02) — (1.506B-02) = (1.816B-02) — (1.656B-01)— (6.465B-02) — (1.019B-01)— (1.530EB-02) 
Oss 1.325B-01 1.027B-01 2.110E-01 1.274B-01 4.905E-02 1.271B-01 1.935B-01 1.827B-01 9.899E-02 5.765E-02 
(2.147B-02) — (2.671B-02) — (3.586B-02) — (3.223B-02) — (1.172B-02)+ (2.515B-02) — (3.356B-02) — (2.387B-02) — (3.031B-02)— (1.630B-02) 
Ti 2.023E-01 2.342E-01 2.650E-01 1.700E-01 3.312E-01 2.216E-01 1.750E-01 2.058E-01 2.262E-01 2.173E-01 
N (1.796B-02) = (2.409B-02) — (3.039B-02) — (2.209B-02)+ (4.970B-02) — (2.802B-02) = (2.561B-02)+ (2.928B-02)= (3.656B-02) (3.024E-02) 
(as 2.317E+00 2.017E+00 4.028E+00 2.565E+00 3.014E+00 3.050E+00 4.029E+00 2.381E+00 3.098E+00 2.302E+00 
O (2.404B-01) (3.777B-01)+ (8.097B-01) — (5.117B-01)— (6.550B-01)— (7.261B-01)— (4.781B-01)— (5.504B-01) (8.706B-01)— (3.029E-01) 
N" 8.275E+00 9.024E+00 1.067E+01 8.195E+00 1.006E+01 1.020E+01 9.860E+00 9.419E+00 1.001E+01 8.186E+00 
a (4.005B-01)= (6.421B-01)— (4.629B-01) — (7.204B-01) = (9.200B-01)— (1.150E+00) — (4.186B-01)— (4.113B-01)— (7.255B-01)— (4.369E-01) 
>17 1.450E+02 1.839E+02 2.559E+02 1.287E+04 2.132E+01 3.720E+02 4.516E+03 2.190E+02 1.911E+02 5.354E+02 
maa (7.455E+01)+ (9.060E+01) (1.890E+02)+ (4.573E+04)— (3.919E+01)+ (1.824E+02)+ (8.345E+03)— (1.141E+02)+ (1.188E+02)+ (2.847E+02) 
>< 6.140E+00 5.044B+00 1.144B+401 1.738E+02 5.724E+00 1.924E+01 2.438E+01 9.581E+00 8.581E+00 6.824E+00 
(2.329E+00)% (2.491E+00) (5.214E+00)— (6.441E+02)— (2.761E+00) = (6.766E+00) — (1.585E+01)— (3.859E+00) — (3.767E+00) — (3.374E+00) 
©... 2.457E+00 3.030E+00 9.150E+00 4.145E+00 2.941E+00 2.721E+00 3.804E+00 3.109E+00 2.824E+00 2.170E+00 
( a (6.729B-01) = (7.932B-01) — (1.501B+00) — (5.413B-01)— (8.011B-01)— (5.402B-01)— (2.256E+00)— (4.008E-01)— (7.106E-01)— (6.762E-01) 
n m20 2.304E+00 3.588E+00 7.385E+00 1.458B+02 3.646E+00 7.022E+00 1.474B+01 5.787E+00 5.298E+00 7.665E+00 
K os (9.133B-01)+ (1.259B+00) (1.903E+00) (1.416E+02)— (8.233E+00)+ (4.049E+00) = (3.599E+00) — (2.114E+400)+ (1.697E+00)+ (3.330E+00) 
«> 9.962E+01 5.469B+01 9.400B+01 7.733E+03 2.066E+01 1.400B+02 3.617E+02 1.015B+02 4.058E+01 1.779E+02 
(8.274E+01)+ (6.400B+01) (7.693E+01)+ (2.400E+04) — (6.055E+01)+ (1.125E+402)% (1.713E+02)— (7.229B+01)+ (5.136E+01)+ (9.995E+01) 
F22 7.622E+01 2.758E+01 9.878E+01 1.085B+02 1.636B+402 1.960B+02 1.025B+02 6.862E+01 6.398E+01 1.442E+02 
(5.714E4+01)+ (6.156E+00)+ (6.610B+01)% (7.497E+01)% (7.391E+01)% (1.306E+02) — (6.141B+401)% (5.767E+01)+ (6.827E+01)+ (5.450E+00) 
F23 2.000E+02 2.000E+02 3.140E+02 3.152E+02 3.152E+02 3.152E+02 3.140E+02 3.152E+02 3.152E+02 2.000E+02 
(0.000E+00)~ (0.000E+00) = (0.000E+00) — (5.782B-14) — (7.707B-06) — (5.782B-14) — (1.573E-13)— (5.782E-14)— (1.455E-13)— (0.000E+00) 
F24 2.000E+02 2.000E+02 2.255E+02 2.249E+02 2.244E+02 2.236E+02 2.242E+02 2.230E+02 2.207E+02 2.000E+02 
(6.004B-10) = (8.444B-14) (3.431E+00)— (2.447E+00) — (2.324E+00) — (8.835B-01)— (9.597B-01)— (7.671B-01)— (6.986E+00) — (2.146E-10) 
F25 2.000E+02 2.000E+02 2.002E+02 2.038E+02 2.086E+02 2.028E+02 2.002E+02 2.029B+02 2.028E+02 2.000E+02 
(0.000E-+00)= (0.000B+00) = (2.430B-03) — (1.074E+00) — (1.921E+00) — (2.914B-01)— (2.738B-02) — (2.666B-01)— (2.876B-01)— (0.000E+00) 
F26 1.001B+02 1.001B+02 1.002B+02 1.001B+02 1.371B+402 1.001B+02 1.002B+02 1.002E+02 1.001B+02 1.434E+02 
(1.562B-02)+ (2.502B-02)+ (2.813B-02) = (3.439B-02)+ (4.315E+01)% (1.959B-02)+ (3.865B-02) (2.599B-02) = (5.815B-02)+ (5.032E+01) 
F27 2.033E+02 2.000B+02 4.865E+02 3.190B+02 3.021B+02 3.569E+02 3.600E+02 3.569E+402 4.004E+402 2.098E+02 
(1.826B+01)% (0.000E+00)+ (1.503E+02) — (3.683E+01)— (1.158E+01)— (5.061E+01)— (4.947E+01)— (5.061E+01)— (2.397B-01)— (3.908E+01) 
F28 2.000E+02 2.000E+02 3.704E+02 7.657E+02 8.972E+02 8.182E+02 3.825E+402 7.956E+02 8.260E+402 2.000E+02 
(0.000E-+00) = (0.000B+00) (2.056B+00) — (6.146E+01)— (2.503E+01)— (2.605E+01)— (6.518E+00)— (1.740E+01)— (2.681E+01)— (0.000E+00) 
F29 2.000E+02 7.161E+02 2.111E+02 7.177E+02 2.582E+02 7.162E+02 2.136E+02 6.734E+02 6.465E+02 2.000E+02 
(0.000E+00)~ (2.564E+00)— (3.118E+00)— (3.883E+01)— (7.806E+01)— (2.220E+00)— (9.651E-01)— (1.756E+02)— (1.843E+02)— (0.000E+00) 
F30 2.000E+02 9.258E+02 3.233E+02 1.811E+03 1.747E+03 9.599E+02 3.664E+02 4.827E+02 5.617E+02 2.000E+02 
(8.444B-14) = (3.513E+02)— (6.869B+01)— (7.022E+02) — (3.984E+02) — (3.380E+4+02) — (1.070B+402) — (1.042B+402)— (1.856E+02)— (6.581E-05) 
= 6 12 20 21 18 19 21 17 19 
+ 9 12 4 4 4 5 3 5 7 
z= 15 6 6 5 8 6 6 8 4 
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Table 4: Results of the ten algorithms for the CEC 2014 functions with 50 in dimensionality. ”+” or ”—” denotes that 


the current result is significantly better or statistical worse than the result of our algorithm in terms of Wilcoxon’s 


rank sum test at a 0.05 significance level, respectively. 


difference 


QD 


Meanwhile, ”” represents that there is no significant 


Average (standard deviation) 


Funckiana L-SHADE-EpSin UMOBAs-II MPEDE ETI-JADE HS-ES AMECoDEs EDEV MLCC-SI NDE HS-ES-DE 
Fl 9.125E-05 1.788B-03 8.062E+04 1.472E+04 2.258E-09 2.644E+04 2.148E+04 2.944E+05 1.066E+05 1.594E-12 
(2.613B-04) — (1.051B-03) — (5.965B+04) — (1.267E+04) — (3.469B-09) — (1.710E+04) — (1.879B+04) — (1.000B+05) — (4.911B+404)— (1.266B-12) 
F2 3.316E-14 2.624E-13 5.305E-14 9.853E-14 1.873B-09 3.221B-14 1.326B-14 2.271B-04 3.840E-03 4.453E-14 
(1.077B-14) = (1.936B-13) — (1.624B-14) = (3.048B-13) = (2.328B-09) — (9.827B-15)= (1.937B-14)+ (1.899B-04) — (7.727B-03) — (1.615B-14) 
F3 5.684E-14 1.137B-13 8.633E-05 2.619B+02 1.200B-09 1.042B-13 6.126E-03 6.037E-01 5.497E-05 5.684E-14 
(0.000E+00)+ (3.657B-14) — (1.377B-04) — (2.025E+02) — (1.750B-09) — (5.987B-14) = (3.017B-02) — (3.306E+00) — (7.699B-05) — (0.000E+00) 
F4 5.313E+01 3.926B+401 9.037E+00 1.981B+01 3.254B+00 4.649E+01 4.929E-01 6.301E+01 5.525E+01 1.762B-13 
(4.893E+01)— (4.891B+01)— (3.080E+00) — (3.983E+01)— (1.783E+01)— (4.742E+01)— (1.790B+00) — (3.114B+401)— (4.171E+01)— (1.016B-13) 
F5 2.025E+01 2.000E+01 2.051E+01 2.000E+01 2.000E+01 2.001E+01 2.057E+01 2.032E+01 2.029E+01 2.000E+01 
(5.854B-02) — (2.202B-04)+ (4.198B-02) — (1.549B-03) — (1.164B-04) = (1.094B-02) — (1.041B-01)— (7.044B-02) — (1.208B-01)— (1.292B-04) 
F6 6.942E-02 1.606B-01 1.162B+01 1.988E+00 4.070E-05 1.591B+00 3.266E+00 1.039B-01 9.799E+00 2.599E-01 
(1.795B-01)+ (3.198B-01)+ (3.806E+00) — (1.595E+00) — (8.368B-05)+ (1.046B+00) — (2.084E+00) — (2.075B-01)+ (4.097E+00) — (5.616E-01) 
F7 1.023E-13 1.137E-13 1.808E-03 2.136E-03 9.665E-10 8.216E-04 2.547E-03 1.137E-13 1.068E-03 0.000E+00 
(3.469E-14)— (0.000E+00)— (3.715B-03) — (4.028B-03) — (2.188B-09) — (2.535B-03) — (4.597B-03) — (0.000B+00) — (2.798B-03) — (0.000E+00) 
F8 5.122E-10 2.107E-12 1.137E-13 7.579E-15 1.526E+00 9.474E-14 0.000E+00 2.361E-09 8.822E+00 1.254E+01 
= (1.021B-09)+ (1.114B-12)+ (0.000B+00)+ (2.884B-14)+ (1.273E+00)+ (4.309B-14)+ (0.000E+00)+ (3.422B-09)+ (5.191E+00)+ (4.036E+00) 
=» 2.709E+01 4.146E+00 5.323E+01 4.643E+01 8.291E-01 5.550E+01 6.201E+01 4.833E+01 5.850E+01 1.932E+01 
(7.139E+00)— (1.457E+00)+ (1.041E+01)— (8.765E+00)— (7.429E-01)+ (1.516E+01)— (1.154E+01)— (8.437E+00) — (3.194E+401)— (4.587E+00) 
10 5.186E-02 5.356E-01 3.074B+01 8.286E-02 2.038E+02 1.391B+01 7.840B-02 7.965E+00 1.213E+01 4.045E+02 
(2.122B-02)+ (5.694B-01)+ (1.422B+01)+ (3.586B-02)+ (1.591E+4+02)% (1.941E+4+00)+ (9.343B-02)+ (2.945E+00)+ (6.579E+01)+ (3.440B+02) 
©: 3.061E+03 3.503E+03 6.325E+03 2.705E+03 5.548E+02 3.733E+03 5.706E+03 3.978E+03 4.945E+03 1.399E+03 
O (3.020E+02)— (5.835E+02)— (6.945E+02)— (6.353E+02)— (2.348E+02)+ (9.909E+02) — (1.665E+03)— (5.715E+02)— (8.093E+402) — (5.386E+02) 
oO” 2.126E-01 1.229B-01 6.446E-01 6.838E-02 2.477E-02 5.562E-02 8.023E-01 3.302E-01 1.461B-01 1.546B-02 
d (2.664B-02) — (7.328B-02) — (1.064B-01)— (2.844B-02) — (2.376B-02) = (1.548B-02) — (3.463B-01)— (6.663B-02) — (1.097B-01)— (1.250E-02) 
Oss 2.088E-01 1.499B-01 2.900E-01 2.211E-01 7.023E-02 1.981B-01 3.057E-01 2.834E-01 1.602B-01 1.359B-01 
(1.641B-02) — (3.260B-02) = (3.993B-02) — (3.726B-02) — (1.186B-02)+ (2.919B-02) — (4.528B-02) — (3.485B-02) — (4.191B-02) — (2.565B-02) 
Ti 1.942E-01 2.908E-01 2.960E-01 1.986E-01 3.988E-01 3.031E-01 2.512E-01 2.697E-01 2.831E-01 2.606E-01 
N (2.056E-02)+ (2.743B-02) — (3.476B-02) — (3.156B-02)+ (4.127B-02) — (3.263B-02) — (2.944B-02) ~% (2.215B-02)~ (4.224B-02) — (3.116E-02) 
(aS 5.437E+00 5.274E+00 6.491E+00 5.004E+00 4.736E+00 5.922E+00 9.165E+00 6.614E+00 5.487E+00 4.611E+00 
O (6.345E-01)— (9.345E-01)— (2.007E+00)— (1.000E+00)— (9.544B-01) (1.050E+00) — (1.135E+00)— (1.379E+00) — (1.041E+00)— (4.973E-01) 
N" 1.670E+01 1.804E+01 1.927E+01 1.629E+01 1.863E+01 1.876E+01 1.853E+01 1.842E+01 1.887E+01 1.621E+01 
a (4.526B-01)— (1.027B+00) — (5.247B-01) — (1.127E+00) (8.725B-01)— (1.071E+00) — (6.409B-01)— (4.335B-01)— (6.354B-01)— (5.559B-01) 
>17 3.335E+02 1.108E+03 1.962E+03 2.396E+03 1.596E+03 2.036E+03 7.458E+03 1.160E+03 9.095E+02 1.603E+03 
— (1.397B+02)+ (3.853E+02)+ (5.862E+02) — (6.505E+02) — (1.330B+03)% (3.949B+02) — (1.588E+404)— (3.665E+4+02)+ (3.767E+02)+ (3.961E+02) 
>< 1.841B+01 7.297B+01 1.399B+02 1.822B+402 8.301E-01 1.247B+02 1.398E+02 3.684E+01 3.141E+401 2.190E+01 
(4.616E+00)+ (1.920B+01)— (5.867E+01)— (5.271E+01)— (6.565B-01)+ (2.795E+01)— (7.957E+01)— (9.040E+00) — (1.059E+01)— (6.292E+00) 
©. 9.908E+00 8.331E+00 1.161B+01 7.553E+00 7.145E+00 5.934E+00 2.269E+01 9.973E+00 1.006E+01 5.902E+00 
Cc (6.301B-01)— (2.190B+00) — (3.087E+00) — (2.748E+00) — (9.264B-01)— (6.735B-01)% (2.240B+401)— (4.701B-01)— (6.840B-01)— (8.251B-01) 
n m20 5.664E+00 1.402E+01 6.228E+01 5.226E+02 2.267E+00 6.536E+01 5.903E+01 2.601E+01 3.219E+01 8.656E+01 
K om (1.469E+00)+ (4.798E+00) (3.807E+01) (3.607E+02)— (5.798E-01)+ (2.404E+01)+ (4.815E+01)+ (6.282E+00)+ (1.138E+01)+ (3.128E+01) 
Q- 3.522E+02 4.819E+02 7.776E+02 1.903E+04 1.378E+03 8.932E+02 2.813E+03 4.735E+02 4.859E+02 1.013E+03 
(1.082E+02)+ (1.273E+02) (2.254E+02) (7.486E+04)— (5.512E+02)— (3.198E+02)% (5.240E+03)— (1.315E+02)+ (1.579E+02)+ (2.690E+02) 
F22 1.098E+02 1.512E+02 5.573E+02 4.618E+02 1.606E+02 5.710E+02 3.851E+02 2.822E+02 4.022E+02 1.704E+02 
(7.371E4+01)% (8.327B+01) (1.919B+02) — (1.734E+02) — (5.624E+01)% (2.376E+02) — (1.607E+02)— (1.220B+402)— (2.490B+02) — (7.905E+01) 
F23 2.000E+02 2.000E+02 3.370E+02 3.440B+02 3.440E+02 3.440E+02 3.370E+02 3.440B+402 3.440E+402 2.000E+02 
(0.000E+00)~ (0.000B+00) (0.000B+00) — (3.156B-13)— (2.192B-05) — (1.734B-13) — (6.443B-13)— (2.598B-13)— (2.891B-13)— (0.000E+00) 
F24 2.000B+02 2.000B+02 2.774B+02 2.737E+02 2.686E+02 2.732E+02 2.728E+02 2.579E+02 2.708E+02 2.000E+02 
(3.929E-09) = (1.154B-13) (1.453E+00)— (2.669E+00) — (1.721E+00) — (1.712E+00) — (2.935E+00) — (1.884E+00) — (2.561E+00) — (2.117E-10) 
F25 2.000E+02 2.000E+02 2.003E+02 2.163E+02 2.159E+02 2.070E+02 2.184E+02 2.065E+02 2.060E+02 2.000E+02 
(0.000E-+00)= (0.000B+00) = (2.549B-02) — (6.935E+00) — (3.229E+00) — (3.437E+00) — (9.367E+00) — (1.033E+00)— (5.869B-01)— (0.000E+00) 
F26 1.002B+02 1.001B+02 1.003B+02 1.036B+02 1.183B+402 1.002B+02 1.402E+02 1.003E+02 1.002E+02 1.036E+02 
(1.996B-02)+ (3.587B-02)+ (2.991B-02)+ (1.821E+01)% (3.261E+01)— (3.361B-02)+ (4.967E+01)— (2.952B-02)= (8.257B-02) (1.821E+01) 
F27 2.033E+02 2.000B+02 8.679E+02 4.407E+02 3.000B+02 3.498E+02 4.177E+02 3.090E+02 3.841E+402 2.033E+02 
(1.826E+01)% (0.000E+00) = (2.358E+02)— (5.567E+01)— (2.167B-03) — (3.182E+01)— (9.408E+01)— (1.825E+401)— (5.297E+01)— (1.826E+01) 
F28 2.000E+02 2.000E+02 3.662E+02 1.089B+03 1.226B+03 1.106B+03 3.741E+402 1.144B+03 1.140B+03 2.000E+02 
(0.000E-+00)= (0.000B+00) = (3.082E+00) — (4.562E+01)— (7.565E+01)— (3.877E+01)— (6.810E+00) — (3.563E+401)— (4.267E+01)— (0.000E+00) 
F29 2.000E+02 7.977E+02 2.077E+02 8.908E+02 4.890E+02 8.120E+02 2.253E+02 5.890E+02 7.630E+02 2.000E+02 
(0.000E+00) = (2.950B+01)— (2.017B+00) — (6.270E+01)— (3.018E+01)— (3.958E+01)— (3.055E+00) — (1.112E+02)— (6.117E+01)— (0.000E+00) 
F30 2.000B+02 8.838E+03 8.742B+402 9.710E+03 8.768E+03 8.896E+03 9.310E+402 8.539E+03 8.999E+03 2.000E+02 
(0.000E-+00)= (5.284B+02) — (2.107B+02) — (7.522E+02)— (3.676E+02) — (5.571E+02) — (1.698E+02) — (4.006B+02) — (5.673E+02) — (0.000E+00) 
= qi 14 24 24 17 22 25 22 24 
+ 10 9 5 3 7 4 4 6 5 
z= 9 7 3 6 4 1 2 
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Table 5: Results of the ten algorithms for the CEC 2014 functions with 100 in dimensionality. ”+” or ”—” denotes 


that the current result is significantly better or statistical worse than the result of our algorithm in terms of Wilcoxon’s 


rank sum test at a 0.05 significance level, respectively. Meanwhile, ” ~œ” represents that there is no significant difference 


Average (standard deviation) 


Fonckion L-SHADE-EpSin UMOEAs-II MPEDE ETI-JADE HS-ES AMECoDEs EDEV MLCC-SI NDE HS-ES-DE 

F1 1.567E+04 3.977E-03 2.466E+05 1.252B+05 1.202B-01 1.959B+05 1.201B+05 5.818E+06 9.691E+405 1.209B-01 
(9.141B+03)— (5.433B-04)+ (1.094B+05) — (8.276E+04) — (1.771B-01) (6.112B+404) — (6.952E+404) — (1.077E+06) — (2.990E+05) — (9.925E-02) 

F2 5.381E-13 1.828B-09 2.084E-13 4.180E-10 1.991B-09 2.002E-12 2.417B-10 1.343E+02 1.898E+03 2.554B-12 
(4.416B-13) (3.213B-09) — (1.193B-13)+ (1.226B-09) — (3.114B-09) — (1.015B-11)+ (4.096B-10) — (7.603E+01)— (2.767E+03) — (4.839E-12) 

F3 3.790E-13 8.522E-09 6.584E+02 1.763B+02 1.200B-08 3.070E-03 2.772E+00 1.590B+00 1.099B+01 1.016E-10 
(1.027B-13)+ (1.289B-08) — (9.622B+02) — (1.619E+02) — (2.340B-08) — (1.088B-02) — (4.667E+00) — (1.336E+00) — (1.055E+01)— (6.025B-11) 

F4 1.765B+02 1.639B+02 6.245E+401 8.381E+01 5.392E+01 1.031B+402 2.106E+01 1.710B+02 1.726B+02 4.854E+01 
(3.059B+01)— (3.071B+01)— (3.144B+01)% (5.081E+01)— (6.836E+01)% (4.127E+01)— (4.615E+01)% (4.113E+401)— (3.293E+401)— (6.632E+01) 

F5 2.056E+01 2.000E+01 2.078E+01 2.000E+01 2.000E+01 2.004E+01 2.078E+01 2.054E+01 2.048E+01 2.000E+01 
(4.743B-02) — (1.070B-04)+ (4.224B-02) — (4.158B-03) — (1.036B-04) = (2.611B-02) — (2.306B-01)— (5.632B-02) — (2.659B-01)— (5.411E-05) 

F6 3.567E-01 9.055E+00 5.495E+01 2.141B+01 1.637B+00 2.636E+01 3.690E+01 1.056B+01 5.788E+01 6.148E+00 
(4.910B-01)+ (2.671E+00) — (7.274E+00) — (9.510E+00) — (9.162B-01)+ (2.999E+00) — (4.760E+00) — (2.435E+00)— (1.598E+401)— (2.007E+00) 

F7 2.122E-13 3.070E-13 1.888E-03 5.751E-04 9.737E-09 1.151B-03 1.968B-03 7.511E-12 2.873E-03 1.781E-13 
(3.931B-14) = (9.512B-14) — (4.866B-03) — (2.212B-03) = (3.141B-08) — (3.019B-03) — (5.825B-03) — (5.738B-12)— (6.720B-03) — (5.730E-14) 

F8 3.526E-03 6.124E-12 2.322E-01 1.099E-13 3.880E+00 2.274E-13 0.000E+00 1.726B+01 2.867E+01 3.897E+01 
(2.388B-03)+ (2.183B-12)+ (5.015B-01)+ (2.076B-14)+ (1.149B+00)+ (0.000E+00)+ (0.000E+00)+ (4.067E+00)+ (2.506E+01)+ (8.188E+00) 

= 5.612E+01 2.560E+01 1.801B+402 1.427B+02 2.653E+00 9.764E+01 1.723E+02 1.249B+02 9.873E+01 7.058E+01 
(1.097E+01)+ (4.923E+00)+ (2.890B+01)— (1.470E+01)— (1.659E+00)+ (1.326E+401)— (3.085E+01)— (2.163E+401)— (3.002E+01)— (1.463E+01) 

Sio 1.968E+01 8.529E+01 5.066E+00 8.450E-01 6.192E+02 4.123E+01 7.874E-01 2.497B+02 3.927E+01 1.669E+03 
LO (4.315E+00)+ (1.359E+02)+ (2.553E+00)+ (8.016E-01)+ (3.222E+02)+ (3.593E+00)+ (2.636B-01)+ (1.160E+02)+ (2.290E+01)+ (4.281E+02) 

O 1.053E+04 1.162E+04 1.229E+04 9.304E+03 2.066E+03 1.076B+04 1.063E+04 1.308E+04 1.221B+04 6.167E+03 
(5.208E+02)— (8.615E+02)— (1.464B+03) — (1.172E+03) — (3.655E+02)+ (1.626E+03) — (1.050B+03) — (1.853E+403) — (1.328E+403) — (1.113E+03) 

12 4.361E-01 2.515E-01 1.092B+00 8.752E-02 1.662B-02 1.514B-01 8.641E-01 7.339E-01 2.882E-01 1.322B-02 
(4.035B-02) — (1.143B-01)— (6.026B-01) — (3.132B-02) — (1.553B-02) = (3.683B-02) — (6.123B-01)— (9.634B-02) — (2.023B-01)— (1.044B-02) 

(JE 3.225E-01 1.963E-01 3.942E-01 3.159E-01 8.783E-02 2.923E-01 3.838E-01 3.517E-01 2.860E-01 2.384E-01 
= (2.239B-02) — (4.381B-02)+ (4.715B-02) — (3.328B-02) — (1.547B-02)+ (3.354B-02) — (3.941B-02) — (3.270B-02) — (5.836B-02) — (3.486E-02) 

N. 1.704E-01 3.251E-01 3.180E-01 2.346E-01 3.713E-01 3.144E-01 2.758E-01 2.960E-01 2.323E-01 2.680E-01 
y (1.113E-02)+ (1.767B-02) — (3.466B-02) — (2.418B-02)+ (3.025B-02) — (2.394B-02) — (2.507B-02) (1.636B-02) — (2.342B-02)+ (1.764B-02) 

Qe 1.640B+01 1.256B+01 1.726B+01 1.960B+01 1.193B+401 1.478E+01 2.097E+01 3.114E+401 1.191B+01 1.124B+01 
(1.122E+00) — (1.143E+00) — (2.798E+00) — (3.251E+00)— (1.813E+00)% (4.561E+00) — (3.128E+00)— (5.603E+00) — (1.510E+00)% (1.432E+00) 

16 3.877E+01 4.166E+01 4.102E+401 3.919B+01 4.115E+01 4.082E+01 4.021E+01 4.163E+01 4.248E+01 3.780E+01 
(6.385E-01)— (1.188E+00)— (6.775E-01)— (2.085E+00)— (1.128E+00)— (1.829E+00)— (7.755E-01)— (7.186E-01)— (1.183E+00)— (9.214E-01) 

CW 2.075E+03 4.314B+403 3.794B+04 1.306B+404 1.527B+03 1.651B+4+04 8.652E+03 4.283E+404 9.248E+03 4.865E+03 
a6 (4.706E+02)+ (6.258E+02)+ (2.599B+04) — (9.489E+03) — (2.163E+03)+ (5.873E+03) — (2.869E+03) — (1.888E+404)— (4.146E+03) — (7.468E+02) 

Fis 8.995E+01 2.231E+02 4.509E+02 5.979E+02 1.659B+00 4.150E+02 3.577E+02 2.729B+02 2.530E+02 1.874E+02 
— (1.846E+01)+ (1.078E+01)— (2.925B+02)— (4.762E+02) — (9.665B-01)+ (2.075E+02) — (1.125B+402)— (1.644B+402)— (2.943E+401)— (4.158E+01) 

Én 8.887E+01 9.674E+01 2.465E+01 9.526E+01 7.127E+01 9.625E+01 2.969E+01 9.248E+01 9.158E+01 7.332E+01 
© (1.448E+00)— (2.347E+00)— (4.867E+00)+ (2.275E+01)— (2.287E+01)% (4.854E+00)— (1.224E+01)+ (2.764E+00)— (1.570E+00)— (2.361E+01) 

m 2.064E+01 1.385E+02 6.066E+02 1.688E+03 3.579B+02 5.433E+02 3.178E+02 2.057B+02 3.384E+402 3.408E+02 
i (4.247B+00)+ (4.728E+01)+ (2.640B+02) — (1.848E+03) — (2.102E+02) — (1.362E+02) — (1.644E+402)% (4.135E+401)+ (9.327B+01)% (7.599B+01) 

fl oma 5.848E+02 1.900E+03 6.911E+03 3.855E+03 3.199E+03 3.851E+03 5.375E+03 4.312E+403 1.723E+03 2.744E+03 
(2.342E+4+02)+ (5.520B+02)+ (5.869B+03) — (1.464E+03) — (6.708E+02) — (1.095E+03) — (8.583E+03)— (1.570E+03) — (4.510E+02)+ (5.709E+02) 

Q2 1.078E+03 1.048E+03 2.035E+03 1.399E+03 6.487E+02 1.373E+03 1.341E+03 1.243E+03 1.512E+03 2.991E+02 
(1.831E+02)— (2.899E+02)— (4.194E+02)— (3.246E+02)— (4.000E+02)— (4.612E+02)— (3.047E+02)— (2.224E+02)— (4.526E+02)— (1.586E+02) 

F23 2.000E+02 2.000E+02 3.450E+02 3.482E+02 3.483E+02 3.482E+02 3.450E+02 3.482E+02 3.482E+02 2.000E+02 
(0.000E-+00) = (0.000B+00) (4.264B-13) — (8.444B-14)— (3.827B-03) — (2.828B-13)— (4.679E-12)— (3.947B-08) — (3.839B-12)— (0.000E+00) 

F24 2.000E+02 2.000E+02 3.978E+02 3.993E+02 3.754E+02 3.891E+02 3.907E+02 3.568E+02 3.788E+02 2.000E+02 
(4.825E-11)% (1.059B-11) = (4.726B+00) — (6.032E+00) — (2.719E+00) — (3.453E+00) — (5.090E+00) — (1.075E+00) — (2.791E+00)— (3.019B-10) 

F25 2.000E+02 2.000E+02 2.201E+02 2.716E+02 2.014E+02 2.410E+02 2.344E+02 2.000E+02 2.261E+02 2.000E+02 
(0.000E+00)~ (0.000E+00)~ (2.352E+01)— (6.217E+00)— (2.903E+00) — (1.709E+01)— (2.381E+401)— (2.850B-04) (1.036E+401)— (0.000E+00) 

F26 2.000B+02 2.000B+02 1.536B+02 2.001B+02 2.000B+02 2.001E+02 2.001B+02 2.001B+02 1.568E+02 2.000E+02 
(0.000E-+00)= (0.000B+00) (5.055E+01) (4.545B-03) — (3.864B-02) — (3.599B-02) — (2.368B-02) — (1.515B-02)— (5.028E+401)% (0.000E+00) 

F27 2.067E+02 2.000E+02 1.964B+03 1.031B+03 3.000E+02 6.903E+02 1.043E+03 3.659E+02 6.705E+02 2.033E+02 
(2.542E+401)% (0.000B+00) (2.579B+02) — (1.166E+02) — (1.855B-05) — (7.429E+01)— (8.572E+01)— (2.237B+401)— (7.572E+01)— (1.826B+01) 

F28 2.000E+02 2.000E+02 5.253E+02 2.192E+03 2.347E+03 2.175E+03 6.546E+02 2.249E+03 2.273E+03 2.000E+02 
(0.000E+00)~ (0.000E+00) = (5.214B+01)— (1.824B+02)— (2.696E+02) — (1.084E+402) — (8.904E+01)— (5.373E+401)— (5.619E+01)— (0.000E+00) 

F29 2.000B+02 8.701E+02 2.497B+02 1.311B+03 7.304B+02 9.949B+02 2.501B+02 1.863E+03 1.098E+03 2.000E+02 
(0.000E-+00)= (1.093B+02) — (5.733E+00) — (1.732E+02)— (5.883E+01)— (2.210E+02)— (4.787E+00)— (1.142E+02)— (1.861E+02)— (0.000E+00) 

F30 2.000E+02 7.927E+03 2.517E+03 8.681E+03 6.138E+03 7.738E+03 2.585E+03 6.309E+03 3.796E+03 2.000E+02 
(0.000E-+00)= (9.336B+02) — (4.646B+02) — (1.435E+03) — (1.562E+03) — (1.121E+03) — (5.129B +402) — (5.514B+402)— (7.949B+02) — (0.000E+00) 

= 10 15 24 26 16 27 24 26 23 
+ 10 9 4 3 3 3 
z= 10 6 2 1 o 
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According to Table |3| for the functions with 30 in dimensionality, our HS-ES-DE performs 
significantly better than L-SHADE-EpSin, UMOEAs-II, MPEDE, ETI-JADE, HS-ES, AMECoDEs, 
EDEV, MLCC-SI, and NDE on six, 12, 20, 21, 18, 19, 21, 17, and 19 functions, respectively. 


Meanwhile, HS-ES-DE is inferior to the peers on nine, 12, four, four, four, five, three, five, and 


seven functions, respectively. That is, although our algorithm loses to L-SHADE-EpSin and cannot 


defeat UMOEAs-II, it has better performance than the other all peers. More details are given 


below. 


For the three unimodal functions, HS-ES-DE is superior to UMOEAs-II on three functions 
(F1-F3), MPEDE on one function (F3), ETI-JADE on two functions (F1 and F3), HS-ES 
on three functions (F1-F3), AMECoDEs on one function (F3), EDEV on one function (F1), 
MLCC-SI on one function (F1), and NDE on one function (F1). Meanwhile, our algorithm is 
inferior to L-LSHADE-EpSin on one function (F1) and AMECoDEs on one function (F1). That 
is, our algorithm performs better than UMOEAs-II, MPEDE, ETI-JADE, HS-ES, EDEV, 
MLCC-SI, and NDE, but performs worse than L-SHADE-EpSin. Meanwhile, our algorithm 
is comparable to AMECoDEs. 


For the 13 simple multimodal functions, HS-ES-DE is superior to L-SHADE-EpSin on six 
functions (F4, F5, F9, and F11-F13), UMOEAs-II on six functions (F4, F11-F14, and F16), 
MPEDE on ten functions (F4-F6, F9, and F11-F16), ETI-JADE on seven functions (F4, F5, 
F9, F11-F13, and F15), HS-ES on seven functions (F4, F7-F8, F10, and F14-F16), AME- 
CoDEs on eight functions (F4, F5, F9, F11-F13, F15 and F16), EDEV on eight functions 
(F4, F5, F9, F11-F13, F15, and F16), MLCC-SI on seven functions (F4, F5, F9, F11-F13, 
and F16), and NDE on nine functions (F4-F6, F9, F11-F13, F15, and F16). Meanwhile, our 
algorithm is inferior to LSHADE-EpSin on three functions (F6, F8, and F10), UMOEAs-II 
on five functions (F5, F8-F10, and F15), MPEDE on two functions (F8 and F10), ETI-JADE 
on three functions (F8, F10, and F14), HS-ES on one function (F13), AMECoDEs on two 
functions (F8 and F10), EDEV on three functions (F8, F10, and F14), MLCC-SI on one 
function (F8), and NDE on two functions (F8 and F10). That is, our algorithm performs 


better than all the peers. 


For the six hybrid functions, HS-ES-DE is superior to UMOEAs-II on one function (F19), 
MPEDE on two functions (F18 and F19), ETI-JADE on five functions (F17-F21), HS-ES 
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on one function (F19), AMECoDEs on three functions (F18, F19, and F22), EDEV on five 
functions (F17-F21), MLCC-SI on two functions (F18 and F19), and NDE two functions 
(F18 and F19). Meanwhile, our algorithm is inferior to L-SHADE-EpSin on four functions 
(F17, and F20-F22), UMOEAs-II on five functions (F17, F18, and F20-F22), MPEDE on two 
functions (F17 and F22), HS-ES on three functions (F17, F20 and F21), AMECoDEs on one 
function (F17), MLCC-SI on four functions (F17 and F20-F22), and NDE on four functions 
(F17 and F20-F22). That is, our algorithm performs better than ETI-JADE, and AMECoDEs, 
EDEV, but performs worse than L-SHADE-EpSin, UMOEAs-IT, HS-ES, MLCC-SI, and NDE. 
Meanwhile, our algorithm is comparable to MPEDE. 


For the eight composition functions, HS-ES-DE is superior to UMOEAs-II on two functions 
(F29 and F30), MPEDE on seven functions (F23-F25, and F27-F30), ETI-JADE on seven 
functions (F23-F25, and F27-F30), HS-ES on seven functions (F23-F25, and F27-F30), AME- 
CoDEs on on seven functions (F23-F25, and F27-F30), EDEV on seven functions (F23-F25, 
and F27-F30), MLCC-SI on seven functions (F23-F25, and F27-F30), and NDE on seven 
functions (F23-F25, and F27-F30). Meanwhile, our algorithm is inferior to LSHADE-EpSin 
on one function (F26), UMOEAs-II on two functions (F26 and F27), ETI-JADE on one 
function (F26), AMECoDEs on one function (F26), and NDE on one function (26). That 
is, our algorithm performs better than MPEDE, ETI-JADE, HS-ES, AMECoDEs, EDEV, 
MLCC-SI, and NDE, but performs worse than L-SHADE-EpSin. Meanwhile, our algorithm 
is comparable to UMOEAs-II. 


According to Table |4| for the functions with 50 in dimensionality, our HS-ES-DE performs 


significantly better than L-SHADE-EpSin, UMOEAs-II, MPEDE, ETI-JADE, HS-ES, AMECoDEs, 
EDEV, MLCC-SI, and NDE on 11, 14, 24, 24, 17, 22, 25, 22, and 24 functions, respectively. 
Meanwhile, HS-ES-DE is inferior to the peers on ten, nine, five, three, seven, four, four, six, and 
five functions, respectively. That is, our algorithm has better performance than all of the other 


peers. More details are given below. 


For the three unimodal functions, HS-ES-DE is superior to L-SHADE-EpSin on one function 
(F1), UMOEAs-II on three functions (F1-F3), MPEDE on two functions (F1 and F3), ETI- 
JADE on two functions (F1 and F3), HS-ES on three functions (F1-F3), AMECoDEs on one 
function (F1), EDEV on two functions (F1 and F3), MLCC-SI on three functions (F1-F3), 
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and NDE on three functions (F1-F3). Meanwhile, our algorithm is inferior to L-SHADE- 
EpSin on one function (F3) and EDEV on one function (F2). That is, our algorithm performs 
better than UMOEAs-II, MPEDE, ETI-JADE, HS-ES, AMECoDEs, EDEV, MLCC-SI, NDE. 
Meanwhile, our algorithm is comparable to L-SSHADE-EpSin. 


For the 13 simple multimodal functions, HS-ES-DE is superior to LSSHADE-EpSin on nine 
functions (F4, F5, F7, F9, F11-F13, F15 and F16), UMOEAs-II on seven functions (F4, F7, 
F11, F12, and F14-F16), MPEDE on 11 functions (F4-F7, F9, and F11-F16), ETI-JADE on 
nine functions (F4-F7, F9, F11-F13, and F15), HS-ES on four functions (F4, F7, F14, and 
F16), AMECoDEs on 11 functions (F4-F7, F9, and F11-F16), EDEV on ten functions (F4- 
F7, F9, F1L-F13, F15, and F16), MLCC-SI on nine functions (F4, F5, F7, F9, F11-F13, F15, 
and F16), and NDE on 11 functions (F4-F7, F9, and F11-F16). Meanwhile, our algorithm 
is inferior to L-SHADE-EpSin on four functions (F6, F8, F10, and F14), UMOEAs-II on 
five functions (F5, F6, and F8-F10), MPEDE on two functions (F8 and F10), ETI-JADE 
on three functions (F8, F10, and F14), HS-ES on five function (F6, F8, F9, F11, and F13), 
AMECoDEs on two functions (F8 and F10), EDEV on two functions (F8 and F10), MLCC- 
SI on three functions (F6, F8, and F10), and NDE on two functions (F8 and F10). That 
is, our algorithm performs better than L-SHADE-EpSin, UMOEASs-II, MPEDE, ETI-JADE, 
AMECoDEs, EDEV, MLCC-SI, NDE, but performs worse than HS-ES. 


For the six hybrid functions, HS-ES-DE is superior to LLSHADE-EpSin on one function (F19), 
UMOEAs-II on two functions (F18 and F19), MPEDE on four functions (F17-F19 and F22), 
ETLJADE on six functions (F17-F22), HS-ES on two functions (F19 and F21), AMECoDEs 
on three functions (F17, F18, and F22), EDEV on five functions (F17-F19, F21, and F22), 
MLCC-SI on three functions (F18, F19, and F22), and NDE three functions (F18, F19, and 
F22). Meanwhile, our algorithm is inferior to L-LSHADE-EpSin on four functions (F17, F18, 
F20, and F21), UMOEAs-II on three functions (F17, F20, and F21), MPEDE on two functions 
(F20 and F21), HS-ES on two functions (F18 and F20), AMECoDEs on one function (F20), 
EDEV on one function (F20), MLCC-SI on two functions (F20 and F21), and NDE on three 
functions (F17, F20, and F21). That is, our algorithm performs better than MPEDE, ETI- 
JADE, AMECoDEs and EDEV, but performs worse than L-SHADE-EpSin, UMOEAs-II. 
Meanwhile, our algorithm is comparable to HS-ES, MLCC-SI, and NDE. 
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For the eight composition functions, HS-ES-DE is superior to UMOEAs-II on two functions 
(F29 and F30), MPEDE on seven functions (F23-F25, and F27-F30), ETI-JADE on seven 
functions (F23-F25, and F27-F30), HS-ES on eight functions (F23-30), AMECoDEs on on 
seven functions (F23-F25, and F27-F30), EDEV on eight functions (F23-F30), MLCC-SI 
on seven functions (F23-F25, and F27-F30), and NDE on seven functions (F23-F25, and 
F27-F30). Meanwhile, our algorithm is inferior to LSSHADE-EpSin on one function (F26), 
UMOEAs-II on one function (F26), MPEDE on one function (F26), and AMECoDEs on 
one function (F26). That is, our algorithm performs better than UMOEAs-II, MPEDE, 
ETLJADE, HS-ES, AMECoDEs, EDEV, MLCC-SI, and NDE, but performs worse than L- 
SHADE-EpSin. 


According to Table |5| for the functions with 100 in dimensionality, our HS-ES-DE performs 
significantly better than L-SHADE-EpSin, UMOEAs-II, MPEDE, ETI-JADE, HS-ES, AMECoDEs, 
EDEV, MLCC-SI, and NDE on ten, 15, 24, 26, 16, 27, 24, 26, and 23 functions, respectively. 


Meanwhile, HS-ES-DE is inferior to the peers on ten, nine, four, three, eight, three, three, three, 


and four functions, respectively. That is, although our algorithm cannot defeat L-SHADE-EpSin, 


it has better performance than all of the other peers. More details are given below. 


For the three unimodal functions, HS-ES-DE is superior to L-SHADE-EpSin on one function 
(F1), UMOEAs-II on two functions (F2 and F3), MPEDE on three functions (F1 and F3), 
ETLJADE on three functions (F1-F3), HS-ES on two functions (F2 and F3), AMECoDEs on 
two functions (F1 and F3), EDEV on three functions (F1-F3), MLCC-SI on three functions 
(F1-F3), and NDE on three functions (F1-F3). Meanwhile, our algorithm is inferior to L- 
SHADE-EpSin on one function (F3), UMOEAs-II on one function (F1), MPEDE on one 
function (F2), and AMECoDEs on one function (F2). That is, our algorithm performs better 
than UMOEAs-I, MPEDE, ETI-JADE, HS-ES, AMECoDEs, EDEV, MLCC-SI, and NDE. 
Meanwhile, our algorithm is comparable to L-SHADE-EpSin. 


For the 13 simple multimodal functions, HS-ES-DE is superior to L-SHADE-EpSin on seven 
functions (F4, F5, F11-F13, F15, and F16), UMOEAs-II on eight functions (F4, F6, F7, F11, 
F12, and F14-F16), MPEDE on ten functions (F5-F7, F9, and F11-F16), ETI-JADE on nine 
functions (F4-F6, F9, F11-F13, F15, and F16), HS-ES on three functions (F7, F14, and F16), 
AMECoDEs on 11 functions (F4-F7, F9, and F11-F16), EDEV on nine functions (F5-F7, 
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F9, F11-F13, F15, and F16), MLCC-SI on 11 functions (F4-F7, F9, and F11-F16), and NDE 
on nine functions (F4-F7, F9, F11-F13, and F16). Meanwhile, our algorithm is inferior to 
L-SHADE-EpSin on five functions (F6, F8-F10 and F14), UMOEAs-II on five functions (F5, 
F8-F 10, and F13), MPEDE on two functions (F8, and F10), ETI-JADE on three functions (F8, 
F10, and F14), HS-ES on six functions (F6, F8-F11, and F13), AMECoDEs on two functions 
(F8 and F10), EDEV on two functions (F8, and F10), MLCC-SI on two functions (F8 and 
F10), and NDE on three functions (F8, F10, and F14). That is, our algorithm performs better 
than L-SHADE-EpSin, UMOEAs-II, MPEDE, ETI-JADE, AMECoDEs, EDEV, MLCC-SI, 
and NDE, but performs worse than HS-ES. 


For the six hybrid functions, HS-ES-DE is superior to LSHADE-EpSin on two functions (F19 
and F22), UMOEAs-II on three functions (F18, F19, and F22), MPEDE on five functions (F17, 
F18, and F20-F22), ETI-JADE on six functions (F17-F22), HS-ES on three functions (F20- 
F22), AMECoDEs on six functions (F17-F22), EDEV on four functions (F17, F18, F21, and 
F22), MLCC-SI on five functions (F17-F19, F21, and F22), and NDE four functions (F17-F19 
and F22). Meanwhile, our algorithm is inferior to L'SSHADE-EpSin on four functions (F17, 
F18, F20, and F21), UMOEAs-II on three functions (F17, F20, and F21), MPEDE on one 
function (F19), HS-ES on two functions (F17 and F18), EDEV on one function (F19), MLCC- 
SI on one function (F20), and NDE on one function (F21). That is, our algorithm performs 
better than MPEDE, ETI-JADE, HS-ES, AMECoDEs, EDEV, MLCC-SI and NDE, but 
performs worse than L-SHADE-EpSin. Meanwhile, our algorithm is comparable to UMOEAs- 
Il. 


For the eight composition functions, HS-ES-DE is superior to UMOEAs-II on two functions 
(F29 and F30), MPEDE on seven functions (F23-F25, and F27-F30), ETI-JADE on eight 
functions (F23-F30), HS-ES on eight functions (F23-F30), AMECoDEs on on eight functions 
(F23-F30), EDEV on eight functions (F23-F30), MLCC-SI on seven functions (F23, F24, and 
F26-F30), and NDE on seven functions (F23-F25, and F27-F30). That is, our algorithm per- 
forms better than UMOEAs-II, MPEDE, ETI-JADE, HS-ES, AMECoDEs, EDEV, MLCC-SI, 
and NDE. Meanwhile, our algorithm is comparable to L-SHADE-EpSin. 


The Friedman test of this experiment is given in Table [6] When D = 30, our HS-ES-DE ranks 


third. When D = 50, our HS-ES-DE ranks second. Furthermore, HS-ES-DE ranks first when 
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Table 6: The Friedman test for the first experiment based on the CEC 2014 benchmark test suite 


Ranking Ranking 
Algorithm Algorithm 
D=30 D=50 D=100 D=30 D=50 D=100 
L-SHADE-EpSin 3.183 3.067 3.333 AMECoDEs 5.967 6.250 6.350 
UMOEAs-II 3.633 3.867 4.267 EDEV 6.617 6.917 5.983 
MPEDE 7.217 7.150 6.917 MLCC-SI 5.967 6.217 7.217 
ETI-JADE 6.417 6.550 6.833 NDE 6.017 6.783 6.583 
HS-ES 6.117 4.833 4.567 HS-ES-DE 3.867 3.366 3.100 


D = 100. 

Now that HS-ES-DE performs best when D = 100, we give convergence graphs when D = 100. 
In Figure [I] the convergence graph of the ten DE algorithms for 14 functions is given by plotting 
average of the best fitness in the 30 executions at intervals. For these functions, the average solution 
of our algorithm is not significantly worse than that of anyone among the peers. 

It can be seen from Figure[I] that, in convergence graph of some algorithms, such as UMOEAs- 
II and HS-ES, the best fitness may go worse during the course of execution. The cause is that 
algorithm based on CMA-ES may not keep the ever best solution in execution. The phenomenon 
also exists in the earlier stage of convergence graph of our HS-ES-DE. After all, our algorithm 
begins with HS-ES. On the other hand, it can be seen that L-SHADE-EpSin can improve solution 
even in the final stage. So does our algorithm. For example, in Subfigures (g)-(i) and (k)-(n), the 
convergence graph of the two algorithms shows a suddenly decrease in the terminal part. After all, 


our algorithm ends with L-SHADE-EpSin. 


4.8. Comparison based on the CEC 2017 suite 


In this experiment, our algorithm is still compared with the nine population-based metaheuris- 


tics. The experimental results for the CEC 2017 functions with 30 in D are listed in Tables [7] 
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Figure 1: Convergence graphs of the ten algorithms for the 14 functions in the CEC 2014 benchmark test suite. (a): 
F4, (b): F7, (c): F12, (d): F15, (e): F16, (f): F22, (g): F23, (h): F24, (i): F25 
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Table 7: Results of the ten algorithms for the CEC 2017 functions with 30 in dimensionality. ”+” or ”—” denotes that 


the current result is significantly better or statistical worse than the result of our algorithm in terms of Wilcoxon’s 


rank sum test at a 0.05 significance level, respectively. 


difference 


Meanwhile, 


er 
R 


represents that there is no significant 


Average (standard deviation) 


Funckiana L-SHADE-EpSin UMOBAs-II MPEDE ETI-JADE HS-ES AMECoDEs EDEV MLCC-SI NDE HS-ES-DE 
Fl 0.000E+00 9.000E-15 1.421B-15 3.316E-15 3.289E-10 1.421B-15 4.737E-16 5.211B-15 0.000E+00 4.263E-15 
(0.000E-+00)+ (6.965B-15) — (4.336B-15) = (6.113B-15)= (7.738B-10) — (4.336B-15)= (2.594B-15)+ (6.965B-15) (0.000E+00)+ (6.624B-15) 
F2 1.895B-15 3.505E-14 1.042B-14 1.162B-12 1.260B-07 1.042B-14 5.161E+02 7.200E-13 4.838E-09 3.790E-15 
(7.211B-15)= (3.476B-14) — (1.580B-14) — (3.055B-12)— (2.112B-07) — (1.580B-14)— (2.827E+03) — (2.020B-12)— (2.459B-08) — (9.827B-15) 
F3 7.579E-15 4.926E-14 8.602E-13 3.573E+03 3.648E-10 3.032E-14 1.637B-02 6.253E-14 6.184E-04 3.790E-14 
(1.965B-14)+ (2.468B-14) = (3.690B-12) — (5.293E+03) (6.235B-10) — (2.884B-14)+ (6.369B-02) (4.314B-14)— (3.387B-03) — (2.725E-14) 
F4 5.875E+01 5.661E+01 6.644E-01 4.455E+01 3.056E+00 5.679E+01 1.728E+00 2.866E+01 5.912E+401 3.056E+00 
(1.014E+00) — (1.069B+01)— (1.511E+00)+ (2.745E+01)— (1.715E+00)+ (1.077E+01) — (2.009E+00)+ (2.927B+01)% (1.695E+00) — (1.715E+00) 
F5 1.249E+01 1.227E+00 2.285E+01 2.246E+01 8.557E+00 3.667E+01 3.196E+01 2.106E+01 3.976E+01 7.578E+00 
(1.742E+00)— (1.129E+00)+ (5.083E+00)— (5.630E+00)— (3.109E+00)= (1.023E+401)— (5.952E+00) — (2.946B+400) — (1.983E+401)— (2.306E+00) 
F6 4.604E-09 2.738E-08 1.027B-08 1.137B-13 1.137B-13 9.445E-07 1.137B-13 1.137B-13 4.563E-09 3.735E-09 
(2.498B-08) — (6.749B-08) — (3.499B-08) — (0.000E+00)+ (0.000E+00)+ (3.069B-06) — (0.000E+00)+ (0.000E+00)+ (2.499B-08) — (1.107E-08) 
F7 4.329E+01 3.296E+01 5.748E+01 5.070E+01 4.062E+01 6.227E+01 6.153E+01 5.272E+01 5.965E+01 3.982E+01 
(2.669E+00)— (6.058E-01)+ (5.747E+00)— (4.648E+00)— (4.117E+00)% (7.295E+00)— (5.759E+00)— (4.288E+00)— (1.031E+01)— (3.198E+00) 
F8 1.310E+01 1.194E+00 2.590E+01 2.259E+01 7.794E+00 3.887E+01 3.532E+01 2.286E+01 5.247E+01 6.926E+00 
= (1.915E+00)— (1.264B+00)+ (7.633E+00) — (4.491E+00) — (2.863E+00)% (1.029E+01)— (5.630E+00) — (3.327E+00) — (1.911E+401)— (2.089E+00) 
=» 0.000E+00 0.000E+00 3.029E-02 1.514E-02 0.000E+00 0.000E+00 2.984E-03 0.000E+00 0.000E+00 0.000E+00 
(0.000E+00) = (0.000E+00) = (1.153B-01)% (8.295B-02)~ (0.000E+00) (0.000E+00)~ (1.635B-02)~ (0.000E+00) = (0.000E+00) = (0.000E+00) 
10 1.375B+03 1.468E+03 3.216B+03 1.247B+03 1.038E+03 2.249B+03 3.119E+03 1.973E+03 2.546E+03 5.939E+02 
(1.814E+02)— (2.632B+02) — (4.421B+02)— (3.007E+02) — (4.117E+02) — (6.128E+02) — (6.835E+4+02)— (3.518E+4+02)— (6.487E+02) — (2.010B+02) 
o> 9.728E+00 2.739E+01 1.459B+01 2.814E+401 8.120E+00 1.612B+01 2.852E+01 1.269B+01 1.349B+01 1.927E+01 
O (1.740E+01)+ (2.878E+01) (5.592E+00)+ (2.541E+401)— (1.543E+401)+ (1.877E+01)+ (2.588E+401)— (1.783E+401)% (1.435E+401)% (2.498B+01) 
Cov 4.004E+02 8.338E+02 9.806B+02 1.109B+03 1.279B+01 1.144B+03 2.609B+03 1.342E+03 4.920E+02 9.080E+02 
a (2.218E+02)+ (3.660E+02) (3.163E+02) (4.253E+02)% (5.432E+01)+ (2.673E+02)— (5.206E+03) — (1.323E+403)% (2.284B+402)+ (4.222E+02) 
Ciis 1.554E+01 1.559E+01 2.073E+01 3.629E+01 2.994E+01 2.130E+01 1.754E+02 2.061B+01 1.633E+01 2.197E+01 
(6.276E+00)+ (7.030B+00)+ (7.788E+00) (1.407E+01)— (1.665E+01)% (7.335E+00)% (6.135E+4+02)— (7.349B+00)% (8.074E+400)+ (7.228E+00) 
Feu 2.273E+01 2.256E+01 2.544E+01 1.230B+03 1.139B+01 2.976E+01 2.862E+01 2.090E+01 2.049E+01 4.324E+401 
N (1.066E+00)+ (1.425E+00)+ (2.396E+00)+ (2.441E+03)% (1.011E+01)+ (5.720E+00)+ (9.325E+00)% (9.585E+00)+ (1.002B+401)+ (2.566E+01) 
CNi; 2.638E+00 4.037E+00 9.294E+00 1.117E+03 5.329E+00 7.911E+00 1.449E+01 6.056E+00 4.846E+00 2.959E+00 
O (1.318E+00)% (1.793E+00) — (2.940B+00) — (3.082E+03) — (2.920E+00) — (4.976E+00) — (1.119B+401)— (2.991E+00)— (1.873E+00) — (1.592E+00) 
ar 3.428E+01 5.368E+01 4.253E+02 2.464E+02 2.638E+02 5.874E+02 3.735E+02 2.329E+02 2.655E+02 8.593E+01 
Ea (3.114E+01)% (6.389E+01)+ (1.645E+02)— (1.575E+02)— (2.033E+02)— (2.510E+02)— (2.114B+402)— (1.319B+402)— (2.489B+02)— (1.318E+02) 
>17 2.576E+01 4.155E+01 7.902E+01 4.042E+401 5.580E+01 8.209E+01 5.962E+01 3.008E+01 6.042E+01 3.819E+01 
— (5.643E+00)% (9.161E+00) — (4.747E+01)— (3.005E+01)— (9.446B+01)% (8.562E+01)— (1.520E+401)— (1.084E+401)% (3.751E+01)— (4.258E+01) 
>< 2.104B+01 2.169B+01 2.336E+01 1.607E+04 1.956E+01 2.571E+01 1.791E+02 2.469E+01 2.307E+01 5.895E+01 
(8.563E-01)+ (1.092E+00) (4.643E+00) (2.493E+04)— (5.280E+00)+ (2.525E+00)+ (7.636E+4+02)% (4.075E+00)+ (5.644E+00)+ (4.071E+01) 
©.. 5.409E+00 7.531E+00 7.414E+00 2.961E+02 3.625E+00 6.359E+00 1.372E+01 6.164E+00 5.723E+00 7.818E+00 
Cc (1.513E+00)+ (2.089B+00) (2.700B+00) (7.192E+02) — (1.229E+00)+ (1.972E+00)+ (2.636E+00) — (1.806E+00)+ (1.299B+400)+ (1.644E+00) 
n ==F20 2.977E+01 4.671E+01 8.695E+01 5.056E+01 1.456B+02 1.450B+02 9.660E+01 2.624E+01 7.588E+01 1.246E+02 
— (3.949B+00)+ (1.787B+01) (5.236B+01) (5.831E+01)+ (3.133E+01)— (1.063E+02) = (5.476E+01)% (1.262E+401)+ (7.730E+01)+ (3.878E+01) 
(et 2.124402 1.955B+02 2.249B+402 2.236B+02 2.095E+02 2.379B+02 2.342E+02 2.225E+02 2.391E+02 2.076E+02 
(2.554E+00)— (2.600E+01) (6.624E+00)— (5.833E+00)— (3.608E+00) — (8.886E+400) — (7.830E+400) — (4.837E+00) — (1.928E+401)— (3.593E+00) 
F22 1.000B+02 1.000B+02 2.012B+402 1.000B+02 1.000B+02 1.000B+02 1.000B+02 1.000B+02 1.000B+02 1.000B+02 
(0.000E-+00) = (1.154B-13) = (5.539B+02) (0.000E-+00) = (2.292B-13)= (0.000E+00) = (0.000E+00) = (0.000E+00) = (0.000E+00) = (8.303E-14) 
F23 3.569E+02 3.503E402 3.814E+402 3.680E+02 3.532E+02 3.868E+02 3.763E+02 3.641E+02 3.769E+02 3.467E+02 
(3.216E+00)— (3.275E+00)— (8.612E+00)— (8.167E+00)— (8.438E+00) — (9.786E+00) — (1.116E+401)— (5.939E+00) — (9.196E+00) — (6.419E+00) 
F24 4.297E+02 4.261E+02 4.499E+02 4.409E+02 4.190E+02 4.602E+02 4.387E+02 4.388E+02 4.508E+02 4.186E+02 
(2.349E+00)— (1.783E+00)— (7.328E+00)— (7.296E+00)— (5.633E+00) = (1.324B+401)— (8.561E+00)— (4.882E+00) — (1.204E+01)— (4.897E+00) 
F25 3.867E+02 3.865E+02 3.783E+02 3.870E+02 3.867E+02 3.868E+02 3.784E+02 3.869E+02 3.868E+02 3.867E+02 
(5.426B-03) = (8.147B-01)+ (2.912B-02)+ (1.913B-01)— (2.754B-02) — (5.720B-02) — (1.137B-01)+ (8.992B-02)— (5.742B-02) — (9.805B-03) 
F26 9.581E+02 4.380E+02 1.317B+03 1.139B+03 9.057E+02 1.310B+03 8.320E+02 1.096E+03 1.123E+03 8.131E+02 
(5.388E+01)— (2.961B+02) (1.319B+02)— (9.677E+01)— (1.480B+02) = (2.460E+02) — (4.837E+02) — (8.144E+401)— (3.016E+02) — (2.377E+02) 
F27 5.054B+02 5.027E+02 5.000B+02 5.024B+02 5.179B+02 5.036E+02 5.000B+02 4.990E+02 4.937B+02 5.106E+402 
(5.245E+00)+ (5.212B+00) (1.540B-04)+ (7.070E+00)+ (7.598E+00) — (5.165E+00)+ (1.412B-04)+ (4.791E+00)+ (9.557E+00)+ (6.725E+00) 
F28 3.107E+02 3.034E+02 4.985E+02 3.331E+02 3.241E+02 3.334E+02 3.275E+02 3.328E+02 3.230E+02 3.103E+02 
(3.264E+401)% (1.886B+01) (3.953E+00) — (5.154E+01)— (4.443E+01)% (5.260E+01)— (4.646E+01)— (5.099B+401)— (4.740E+01)% (3.152E+401) 
F29 4.315E+02 4.350E+02 3.373E+02 4.222E+02 4.617E+02 4.613E+02 4.025E+02 4.413E+02 4.388E+02 4.263E+02 
(5.954E+00)— (1.239E+01)— (5.598E+01)+ (3.859E+01)% (4.293E+01)— (4.424E+01)— (6.040E+01)+ (1.883E+01)— (3.317E+01)— (3.038E+01) 
F30 1.998B+03 2.004E+03 2.092B+402 2.097E+03 2.059B+03 2.033E+03 4.792E+402 2.021B+03 2.008E+03 1.985E+03 
(7.075E+01)% (7.070B+01) (2.384E+00)+ (1.180E+02)— (4.010E+01)— (6.830E+401)— (6.847E+02)+ (5.096E+01)— (5.898E+01)% (3.326B+401) 
= t3 10 15 20 13 19 17 16 17 
+ 10 12 9 3 7 6 7 6 8 
z= 9 8 6 7 10 5 6 8 5 
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According to Table |7| for the functions with 30 in dimensionality, our HS-ES-DE performs 
significantly better than L-SHADE-EpSin, UMOEAs-IJ, MPEDE, ETI-JADE, HS-ES, AMECoDEs, 
EDEV, MLCC-SI, and NDE on 11, ten, 15, 20, 13, 19, 17, 16, and 17 functions, respectively. 
Meanwhile, HS-ES-DE is inferior to the peers on ten, 12, nine, three, seven, six, seven, six, and 
eight functions, respectively. That is, although our algorithm loses to UMOEAs-II, it has better 


performance than all of the other peers. More details are given below. 


e For the three unimodal functions, HS-ES-DE is superior to UMOEAs-II on two functions (F1 
and F2), MPEDE on two functions (F2 and F3), ETLJADE on one function (F2), HS-ES 
on three functions (F1-F3), AMECoDEs on one function (F2), EDEV on one function (F2), 
MLCC-SI on two functions (F2 and F3), and NDE on two functions (F2 and F3). Meanwhile, 
our algorithm is inferior to L-SHADE-EpSin on two functions (F1 and F3), AMECoDEs on 
one function (F3), EDEV on one function (F1) and NDE on one function (F1). That is, our 
algorithm performs better than UMOEAs-II, MPEDE, ETI-JADE, HS-ES, MLCC-SI, and 
NDE, but performs worse than L-SHADE-EpSin. Meanwhile, our algorithm is comparable to 
AMECoDEs and EDEV. 


e For the seven simple multimodal functions, HS-ES-DE is superior to L-SHADE-EpSin on six 
functions (F4-F8, and F10), UMOEAs-II on three functions (F4, F6, and F10), MPEDE on 
five functions (F5-F8, and F10), ETI-JADE on five functions (F4, F5, F7, F8, and F10), 
HS-ES on one function (F10), AMECoDEs on six functions (F4-F8, and F10), EDEV on four 
functions (F5, F7, F8, and F10), MLCC-SI on four functions (F5, F7, F8, and F10), and 
NDE on six functions (F4-F8, and F10). Meanwhile, our algorithm is inferior to UMOEAs- 
II on three functions (F5, F7, and F8), MPEDE on one function (F4), ETI-JADE on one 
function (F6), HS-ES on two functions (F4 and F6), EDEV on tWO functions (F4 and F6), 
MLCC-SI on one function (F6). That is, our algorithm performs better than L-SHADE- 
EpSin, MPEDE, ETLJADE, AMECoDEs, EDEV, MLCC-SI, NDE, but performs worse than 
HS-ES. Meanwhile, our algorithm is comparable to UMOEAs-II. 


e For the ten hybrid functions, HS-ES-DE is superior to UMOEAs-II on two functions (F15 and 
F17), MPEDE on three functions (F15-F17), ETI-JADE on seven functions (F11, F13, F15- 
F19), HS-ES on three functions (F15, F16, and F20), AMECoDEs on four functions (F12, and 
F15-F17), EDEV on seven functions (F11-F13, F15-F15, and F19), MLCC-SI on two functions 


25 


390 


395 


400 


405 


410 


415 


(F15 and F16), and NDE on three functions (F15-F17). Meanwhile, our algorithm is inferior 
to L-SHADE-EpSin on seven functions (F11-F14, and F18-F20), UMOEAs-II on five functions 
(F13, F14, F16, F18, and F20), MPEDE on four functions (F11, F14, F18, F20), ETI-JADE 
on one function (F20), HS-ES on five functions (F11, F12, F14, F18 and F19), AMECoDEs 
on four functions (F11, F14, F18, and F19), MLCC-SI on four functions (F14 and F18-F20), 
and NDE on six functions (F12-F14 and F18-F20). That is, our algorithm performs better 
than ETI-JADE, EDEV, but performs worse than L-SHADE-EpSin, UMOEAs-II, MPEDE, 
HS-ES, MLCC-SI, and NDE. Meanwhile, our algorithm is comparable to AMECoDEs. 


For the eight composition functions, HS-ES-DE is superior to L-SHADE-EpSin on five func- 
tions (F21, F23, F24, F26, and F29) UMOEAs-II on three functions (F23, F24, and F29), 
MPEDE on five functions (F21, F23, F24, F26 and F28), ETI-JADE on seven functions (F21, 
F23-F26, F28, and F30), HS-ES on six functions (F21, F23, F25, F27, F29, and F30), AME- 
CoDEs on eight functions (F21, F23-F26, and F28-F30), EDEV on five functions (F21, F23, 
F24, F26, and F28), MLCC-SI on eight functions (F21, F23-F26, and F28-F30), and NDE on 
six functions (F21, F23-F26, and F29). Meanwhile, our algorithm is inferior to L-SHADE- 
EpSin on one function (F27), UMOEAs-II on four functions (F21, and F25-F27), MPEDE 
on four functions (F25, F27, F29 and F30), ETI-JADE on one function (F27), AMECoDEs 
on one function (F27), EDEV on four functions (F25, F27, F29 and F30), MLCC-SI on one 
function (F27), and NDE on one function (27). That is, our algorithm performs better than 
L-SHADE-EpSin, MPEDE, ETI-JADE, HS-ES, AMECoDEs, EDEV, MLCC-SI, and NDE, 
but performs worse than UMOEAs-II. 


The Friedman test for this experiment is given in Table It can be seen that our algorithm 


ranks third. 


4.4. Comparison based on the CEC 2020 suite 


In this experiment, our algorithm is compared with the top three populaiton-based metaheuris- 


tics in the 2020 competition, IMODE, AGSK, and j2020. As mentioned before, both the value of 
MaxF ES taken in the previous CEC competitions and that in the 2020 competitions are employed 
here. The experimental results for the CEC 2020 functions with 20 in D are listed in Table [9] Note 


that dimensionality can be just set 10, 15, and 20 in the new suite. 
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Table 8: The Friedman test for the second experiment based on the CEC 2017 benchmark test suite 


Algorithm Ranking | Algorithm Ranking 
L-SHADE-Epsin 3.483 AMECoDEs 7.567 


UMOEAs-II 4.000 EDEV 6.583 
MPEDE 6.333 MLCC-SI 5.233 
ETI-JADE 6.800 NDE 6.017 
HS-ES 4.783 HS-ES-DE 4.200 


Table 9: Results of the ten algorithms for the CEC 2020 functions with 20 in dimensionality. Here, old rule means 
MazF ES = 2.0E + 05, while new rule means MaxFES = 1.0E + 07. ”+” or ”—” denotes that the current result 


is significantly better or statistical worse than the result of our algorithm in terms of Wilcoxon’s rank sum test at a 


0.05 significance level, respectively. Meanwhile, ” œ~” represents that there is no significant difference 


Average (standard deviation) 


Function IMODE AGSK j2020 HS-ES-DE 
i d Old rule New rule Old rule New rule Old rule New rule Old rule New rule 
= = 1.503E-04 0.000E+00 0.000E+00 0.000E+00 0.000E+00 0.000E+00 0.000E+00 0.000E+00 
(1.870E-05)— — (0.000E+00)~ | (0.000E+00)~  (0.000E+00)~ | (0.000E+00)%  (0.000E+00)~ | (0.000E+00)  (0.000E+00) 
F 2.504E+02 3.463E-01 3.687E+02 .233E+00 .350E+02 6.246E-02 2.150E+01 1.767E+01 
(1.138E+02)— (5.663E-01)+ | (6.486E+01)— (1.359E+00)~ | (9.986E+01)— (0.000E+00)+ | (5.200E+01) (4.153E+01) 
na 3.295E+01 2.046E+01 3.179E+01 2.039E+01 2.700E+01 0.000E+00 2.140E+01 2.071E+01 
(3.820B+00)— (1.245E-01)+ | (1.627E+00)— (0.000E+00)+ | (2.647B+01)—  (0.000H+00)+ | (6.664E-01) (2.614E-01) 
ra 7.171E-02 4.995E-01 1.933E+00 7.749E-01 1.408E+00 1.135E-01 0.000E+00 0.000E+00 
(5.441B-02)— (8.077E-02)— | (1.985E-01)— 1.006E-01)— 1.464E+00)— (8.475E-02)— | (0.000E+00)  (0.000E+00) 
F5 9.493E+02 1.055E+01 3.503E+02 2.917E+01 6.239E+02 1.461E+02 2.984E+02 2.667E+02 
; (3.531B+02)—  (4.112E+00)+ | (1.265E+02)~ (2.939H+01)+ | (2.793E+02)— (7.067H+01)+ | (1.565B+02) (1.776E+02) 
n 5- = ig 2.505E+00 2.868E-01 2.117E+00 .605E-01 .142E+00 1.965E-01 5.317E+00 9.831E-01 
= (5.023E-01)+  (7.395E-02)+ | (2.597E-01)+ 4.994E-02)+ 1.204B+00)+ (1.117E-01)+ | (2.175H+01) (4.973E-01) 
4 P? 5.886E+02 5.098E-01 7.295E+01 5.664E-01 -406E+02 3.961E-01 1.898E+02 1.441E+02 
(2.119E+02)— (1.780E-01)+ | (5.262B+401)® (7.354E-01)+ 1.435E+02)— (1.711E+01)+ | (2.143E+02) (1.243E+02) 
F8 1.004E+02 8.423E+01 1.000E+02 1.000E+02 .000E+02 1.000E+02 1.000E+02 1.000E+02 
(6.515E-01)— (1.833E+01)+ | (3.700E-13)% 8.303B-14)~ 1.000B+02)%  (1.000E+02)+ | (0.000E+00) (8.303E-14) 
ng 1.067E+02 9.667E+01 4.047E+02 9.667E+01 4.225E+02 1.000E+02 3.940E+02 3.891E+02 
(2.568E+01)+  (1.826E+01)+ | (5.759E+01)— (1.826E+01)+ | (4.338E+02)+ (4.113E+02)+ | (5.021E+00)  (1.806E+01) 
F10 4.196E+02 3.997E+02 4.137E+02 3.994E+02 4.138E+02 3.990E+02 4.125E+02 4.126E+02 
(1.674E+01)— (4.441E-01)+ | (8.436E-03)— 2.008E+00)+ | (4.137E+02)— (3.991E-+02)+ | (1.361E4+00)  (1.475E+00) 
— 8 £ 5 6 1 
+ 2 8 1 6 2 8 
x% 0 1 4 3 2 1 
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According to Table [9] when MaxFES = 2.0E +05, our HS-ES-DE performs significantly better 
than IMODE, AGSK, and j2020 on eight, five, and six functions, respectively. Meanwhile, HS-ES- 


DE is inferior to the peers on two, one, and two function(s), respectively. That is, our algorithm 


has better performance than all of the peers. More details are given below. 


For the only one unimodal function, HS-ES-DE is superior to IMODE. 


For the three simple multimodal functions, HS-ES-DE is superior to all the peers on all the 


function. 


For the three hybrid functions, HS-ES-DE is superior to IMODE on two functions (F5 and 
F7), and j2020 on two functions (F5 and F7). Meanwhile, our algorithm is inferior to IMODE 
on one function (F6), AGSK on one function (F6), and j2020 on one function (F6). That is, 
our algorithm performs better than IMODE and j2020, but performs worse than AGSK. 


For the three composition functions, HS-ES-DE is superior to IMODE on two functions (F8 
and F10), AGSK on two functions (F9 and F10), and j2020 on one function (F10). Meanwhile, 
our algorithm is inferior to IMODE on one function (F9), j2020 on one function (F9) That 
is, our algorithm performs better than IMODE and AGSK. Meanwhile, our algorithm is 
comparable to j2020. 


When MazFES = 1.0E +07, our HS-ES-DE performs significantly better than IMODE, AGSK, 


and j2020 on one, one, and one function, respectively. Meanwhile, HS-ES-DE is inferior to the peers 


on eight, six, and eight functions, respectively. That is, the performance of our algorithm is worse 


than all of the peers. 


Table 10: The Friedman test for the experiment based on the CEC 2020 benchmark test suite 


Algorithm Old rule Ranking New rule Ranking 


IMODE 3.300 2.200 
AGSK 2.500 2.400 
j2020 2.400 1.950 

HS-ES-DE 1.800 3.450 
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4.5. Result analysis 


It can be seen that, based on the old rule on MaxF ES, our algorithm is very competitive 
in comparison with all the peers - L-SHADE-EpSin, UMOEAs-II, MPEDE, ETI-JADE, HS-ES, 
AMECoDEs, EDEV, MLCC-SI, NDE, IMODE, AGSK, and j2020. However, based on the new 
rule on MaxF ES, our HS-ES-DE performs much worse than the top three algorithms in the 2020 
competition, IMODE, AGSK, and j2020. In fact, the old rule is for comparing solving ability during 
a short course, while the new one is for comparing that during a long course. In summary, our 


HS-ES-DE has a sound solving ability during a short course. 


5. Conclusion 


For years, population-based metaheuristics have been used for real parameter single objective 
optimization. The competitions on this topic have been held in the series of CEC. Based on L- 
SHADE-EpSin and HS-ES, two winners in the competitions, we propose ensemble with successively 
executed constituent algorithms - HS-ES-DE. In our ensemble, HS-ES is executed firstly. As soon 
as stagnation is detected by our scheme, L-SHADE-EpSin takes over population after our specific 
processing on population. The experiment results show that our ensemble is competitive among 
population-based metaheuristics for real parameter single objective optimization. 

Now that taking over in a right occasion can bring improvement in solution, taking over alter- 
nately deserves of study. In our future study, we will try to enhance HS-ES-DE. More times of 
taking over may occur in the new version. That is, L-SSHADE-EpSin may take over population 
from HS-DE, and vice versa. To this end, processing on population for taking over becomes more 
complex than before. Such a new version of HS-ES-DE may perform better than the current one 


and be fit for either a short course or a long course. 
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